[  467.490418] env[61992]: INFO neutron.common.config [-] Logging enabled!
[  467.490922] env[61992]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  467.491027] env[61992]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=61992) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  467.491226] env[61992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  467.491321] env[61992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  467.492213] env[61992]: WARNING oslo_policy.policy [None req-7434e662-f2cc-45e8-b505-bb73196271d7 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  467.492437] env[61992]: WARNING oslo_policy.policy [None req-7434e662-f2cc-45e8-b505-bb73196271d7 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  467.493656] env[61992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-7434e662-f2cc-45e8-b505-bb73196271d7 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  467.508566] env[61992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-7434e662-f2cc-45e8-b505-bb73196271d7 None None] Session token - acquiring
[  467.509408] env[61992]: DEBUG networking_nsxv3.common.locking [None req-7434e662-f2cc-45e8-b505-bb73196271d7 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  467.509612] env[61992]: DEBUG oslo_concurrency.lockutils [None req-7434e662-f2cc-45e8-b505-bb73196271d7 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=61992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  467.509762] env[61992]: DEBUG oslo_concurrency.lockutils [None req-7434e662-f2cc-45e8-b505-bb73196271d7 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=61992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  467.510171] env[61992]: DEBUG oslo_concurrency.lockutils [None req-7434e662-f2cc-45e8-b505-bb73196271d7 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=61992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  467.520106] env[61992]: DEBUG oslo_concurrency.lockutils [None req-7434e662-f2cc-45e8-b505-bb73196271d7 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=61992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  467.520376] env[61992]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-7434e662-f2cc-45e8-b505-bb73196271d7 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  467.520523] env[61992]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-7434e662-f2cc-45e8-b505-bb73196271d7 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=61992) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  469.526740] env[61992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-7434e662-f2cc-45e8-b505-bb73196271d7 None None] Session token - acquiring
[  469.527138] env[61992]: DEBUG networking_nsxv3.common.locking [None req-7434e662-f2cc-45e8-b505-bb73196271d7 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  469.527251] env[61992]: DEBUG oslo_concurrency.lockutils [None req-7434e662-f2cc-45e8-b505-bb73196271d7 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=61992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  469.527336] env[61992]: DEBUG oslo_concurrency.lockutils [None req-7434e662-f2cc-45e8-b505-bb73196271d7 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=61992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  469.527611] env[61992]: DEBUG oslo_concurrency.lockutils [None req-7434e662-f2cc-45e8-b505-bb73196271d7 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=61992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  469.536839] env[61992]: DEBUG oslo_concurrency.lockutils [None req-7434e662-f2cc-45e8-b505-bb73196271d7 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=61992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  469.537076] env[61992]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-7434e662-f2cc-45e8-b505-bb73196271d7 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  469.537215] env[61992]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-7434e662-f2cc-45e8-b505-bb73196271d7 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=61992) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  471.540237] env[61992]: CRITICAL neutron [None req-7434e662-f2cc-45e8-b505-bb73196271d7 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  471.540237] env[61992]: ERROR neutron Traceback (most recent call last):
[  471.540237] env[61992]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  471.540237] env[61992]: ERROR neutron     sys.exit(main())
[  471.540237] env[61992]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  471.540237] env[61992]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  471.540237] env[61992]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  471.540237] env[61992]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  471.540237] env[61992]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  471.540237] env[61992]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  471.540237] env[61992]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  471.540237] env[61992]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  471.540237] env[61992]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  471.540237] env[61992]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  471.540237] env[61992]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  471.540237] env[61992]: ERROR neutron     response = self.get(path=path, params=params)
[  471.540947] env[61992]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  471.540947] env[61992]: ERROR neutron     raise RuntimeError(msg, last_err)
[  471.540947] env[61992]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  471.540947] env[61992]: ERROR neutron 
[  474.063962] env[62025]: INFO neutron.common.config [-] Logging enabled!
[  474.064447] env[62025]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  474.064510] env[62025]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=62025) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  474.064742] env[62025]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  474.064837] env[62025]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  474.065646] env[62025]: WARNING oslo_policy.policy [None req-ed6aeffc-5002-4bda-b64a-7540a9c3a17b None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  474.065878] env[62025]: WARNING oslo_policy.policy [None req-ed6aeffc-5002-4bda-b64a-7540a9c3a17b None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  474.067065] env[62025]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-ed6aeffc-5002-4bda-b64a-7540a9c3a17b None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  474.080890] env[62025]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ed6aeffc-5002-4bda-b64a-7540a9c3a17b None None] Session token - acquiring
[  474.081618] env[62025]: DEBUG networking_nsxv3.common.locking [None req-ed6aeffc-5002-4bda-b64a-7540a9c3a17b None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62025) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  474.081815] env[62025]: DEBUG oslo_concurrency.lockutils [None req-ed6aeffc-5002-4bda-b64a-7540a9c3a17b None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62025) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  474.081942] env[62025]: DEBUG oslo_concurrency.lockutils [None req-ed6aeffc-5002-4bda-b64a-7540a9c3a17b None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62025) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  474.082293] env[62025]: DEBUG oslo_concurrency.lockutils [None req-ed6aeffc-5002-4bda-b64a-7540a9c3a17b None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62025) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  474.090920] env[62025]: DEBUG oslo_concurrency.lockutils [None req-ed6aeffc-5002-4bda-b64a-7540a9c3a17b None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62025) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  474.091162] env[62025]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ed6aeffc-5002-4bda-b64a-7540a9c3a17b None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  474.091307] env[62025]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ed6aeffc-5002-4bda-b64a-7540a9c3a17b None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=62025) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  476.097360] env[62025]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ed6aeffc-5002-4bda-b64a-7540a9c3a17b None None] Session token - acquiring
[  476.097806] env[62025]: DEBUG networking_nsxv3.common.locking [None req-ed6aeffc-5002-4bda-b64a-7540a9c3a17b None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62025) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  476.097956] env[62025]: DEBUG oslo_concurrency.lockutils [None req-ed6aeffc-5002-4bda-b64a-7540a9c3a17b None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62025) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  476.098112] env[62025]: DEBUG oslo_concurrency.lockutils [None req-ed6aeffc-5002-4bda-b64a-7540a9c3a17b None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62025) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  476.098387] env[62025]: DEBUG oslo_concurrency.lockutils [None req-ed6aeffc-5002-4bda-b64a-7540a9c3a17b None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62025) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  476.107544] env[62025]: DEBUG oslo_concurrency.lockutils [None req-ed6aeffc-5002-4bda-b64a-7540a9c3a17b None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62025) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  476.107779] env[62025]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ed6aeffc-5002-4bda-b64a-7540a9c3a17b None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  476.107919] env[62025]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ed6aeffc-5002-4bda-b64a-7540a9c3a17b None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=62025) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  478.110918] env[62025]: CRITICAL neutron [None req-ed6aeffc-5002-4bda-b64a-7540a9c3a17b None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  478.110918] env[62025]: ERROR neutron Traceback (most recent call last):
[  478.110918] env[62025]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  478.110918] env[62025]: ERROR neutron     sys.exit(main())
[  478.110918] env[62025]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  478.110918] env[62025]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  478.110918] env[62025]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  478.110918] env[62025]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  478.110918] env[62025]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  478.110918] env[62025]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  478.110918] env[62025]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  478.110918] env[62025]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  478.110918] env[62025]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  478.110918] env[62025]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  478.110918] env[62025]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  478.110918] env[62025]: ERROR neutron     response = self.get(path=path, params=params)
[  478.112039] env[62025]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  478.112039] env[62025]: ERROR neutron     raise RuntimeError(msg, last_err)
[  478.112039] env[62025]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  478.112039] env[62025]: ERROR neutron 
[  480.594303] env[62048]: INFO neutron.common.config [-] Logging enabled!
[  480.594695] env[62048]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  480.594771] env[62048]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=62048) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  480.594993] env[62048]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  480.595130] env[62048]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  480.595967] env[62048]: WARNING oslo_policy.policy [None req-6c381cda-13f4-40cd-904c-1550e30bc5b3 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  480.596198] env[62048]: WARNING oslo_policy.policy [None req-6c381cda-13f4-40cd-904c-1550e30bc5b3 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  480.597364] env[62048]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-6c381cda-13f4-40cd-904c-1550e30bc5b3 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  480.611673] env[62048]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-6c381cda-13f4-40cd-904c-1550e30bc5b3 None None] Session token - acquiring
[  480.612425] env[62048]: DEBUG networking_nsxv3.common.locking [None req-6c381cda-13f4-40cd-904c-1550e30bc5b3 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62048) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  480.612619] env[62048]: DEBUG oslo_concurrency.lockutils [None req-6c381cda-13f4-40cd-904c-1550e30bc5b3 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  480.612744] env[62048]: DEBUG oslo_concurrency.lockutils [None req-6c381cda-13f4-40cd-904c-1550e30bc5b3 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  480.613095] env[62048]: DEBUG oslo_concurrency.lockutils [None req-6c381cda-13f4-40cd-904c-1550e30bc5b3 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  480.621857] env[62048]: DEBUG oslo_concurrency.lockutils [None req-6c381cda-13f4-40cd-904c-1550e30bc5b3 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  480.622107] env[62048]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-6c381cda-13f4-40cd-904c-1550e30bc5b3 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  480.622249] env[62048]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-6c381cda-13f4-40cd-904c-1550e30bc5b3 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=62048) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  482.629107] env[62048]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-6c381cda-13f4-40cd-904c-1550e30bc5b3 None None] Session token - acquiring
[  482.629494] env[62048]: DEBUG networking_nsxv3.common.locking [None req-6c381cda-13f4-40cd-904c-1550e30bc5b3 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62048) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  482.629658] env[62048]: DEBUG oslo_concurrency.lockutils [None req-6c381cda-13f4-40cd-904c-1550e30bc5b3 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  482.629787] env[62048]: DEBUG oslo_concurrency.lockutils [None req-6c381cda-13f4-40cd-904c-1550e30bc5b3 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  482.630091] env[62048]: DEBUG oslo_concurrency.lockutils [None req-6c381cda-13f4-40cd-904c-1550e30bc5b3 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  482.639985] env[62048]: DEBUG oslo_concurrency.lockutils [None req-6c381cda-13f4-40cd-904c-1550e30bc5b3 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  482.640261] env[62048]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-6c381cda-13f4-40cd-904c-1550e30bc5b3 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  482.640402] env[62048]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-6c381cda-13f4-40cd-904c-1550e30bc5b3 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=62048) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  484.643374] env[62048]: CRITICAL neutron [None req-6c381cda-13f4-40cd-904c-1550e30bc5b3 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  484.643374] env[62048]: ERROR neutron Traceback (most recent call last):
[  484.643374] env[62048]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  484.643374] env[62048]: ERROR neutron     sys.exit(main())
[  484.643374] env[62048]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  484.643374] env[62048]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  484.643374] env[62048]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  484.643374] env[62048]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  484.643374] env[62048]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  484.643374] env[62048]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  484.643374] env[62048]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  484.643374] env[62048]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  484.643374] env[62048]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  484.643374] env[62048]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  484.643374] env[62048]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  484.643374] env[62048]: ERROR neutron     response = self.get(path=path, params=params)
[  484.644215] env[62048]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  484.644215] env[62048]: ERROR neutron     raise RuntimeError(msg, last_err)
[  484.644215] env[62048]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  484.644215] env[62048]: ERROR neutron 
[  487.037741] env[62095]: INFO neutron.common.config [-] Logging enabled!
[  487.038133] env[62095]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  487.038249] env[62095]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=62095) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  487.038478] env[62095]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  487.038576] env[62095]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  487.039443] env[62095]: WARNING oslo_policy.policy [None req-a93775bf-dca5-408c-a9aa-376539c972d7 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  487.039669] env[62095]: WARNING oslo_policy.policy [None req-a93775bf-dca5-408c-a9aa-376539c972d7 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  487.040889] env[62095]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-a93775bf-dca5-408c-a9aa-376539c972d7 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  487.055314] env[62095]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-a93775bf-dca5-408c-a9aa-376539c972d7 None None] Session token - acquiring
[  487.056094] env[62095]: DEBUG networking_nsxv3.common.locking [None req-a93775bf-dca5-408c-a9aa-376539c972d7 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62095) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  487.056301] env[62095]: DEBUG oslo_concurrency.lockutils [None req-a93775bf-dca5-408c-a9aa-376539c972d7 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  487.056431] env[62095]: DEBUG oslo_concurrency.lockutils [None req-a93775bf-dca5-408c-a9aa-376539c972d7 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  487.056792] env[62095]: DEBUG oslo_concurrency.lockutils [None req-a93775bf-dca5-408c-a9aa-376539c972d7 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  487.065692] env[62095]: DEBUG oslo_concurrency.lockutils [None req-a93775bf-dca5-408c-a9aa-376539c972d7 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  487.065940] env[62095]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-a93775bf-dca5-408c-a9aa-376539c972d7 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  487.066091] env[62095]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-a93775bf-dca5-408c-a9aa-376539c972d7 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=62095) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  489.072267] env[62095]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-a93775bf-dca5-408c-a9aa-376539c972d7 None None] Session token - acquiring
[  489.072744] env[62095]: DEBUG networking_nsxv3.common.locking [None req-a93775bf-dca5-408c-a9aa-376539c972d7 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62095) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  489.072896] env[62095]: DEBUG oslo_concurrency.lockutils [None req-a93775bf-dca5-408c-a9aa-376539c972d7 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  489.073028] env[62095]: DEBUG oslo_concurrency.lockutils [None req-a93775bf-dca5-408c-a9aa-376539c972d7 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  489.073318] env[62095]: DEBUG oslo_concurrency.lockutils [None req-a93775bf-dca5-408c-a9aa-376539c972d7 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  489.082349] env[62095]: DEBUG oslo_concurrency.lockutils [None req-a93775bf-dca5-408c-a9aa-376539c972d7 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  489.082583] env[62095]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-a93775bf-dca5-408c-a9aa-376539c972d7 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  489.084421] env[62095]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-a93775bf-dca5-408c-a9aa-376539c972d7 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=62095) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  491.084963] env[62095]: CRITICAL neutron [None req-a93775bf-dca5-408c-a9aa-376539c972d7 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  491.084963] env[62095]: ERROR neutron Traceback (most recent call last):
[  491.084963] env[62095]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  491.084963] env[62095]: ERROR neutron     sys.exit(main())
[  491.084963] env[62095]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  491.084963] env[62095]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  491.084963] env[62095]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  491.084963] env[62095]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  491.084963] env[62095]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  491.084963] env[62095]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  491.084963] env[62095]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  491.084963] env[62095]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  491.084963] env[62095]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  491.084963] env[62095]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  491.084963] env[62095]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  491.084963] env[62095]: ERROR neutron     response = self.get(path=path, params=params)
[  491.085962] env[62095]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  491.085962] env[62095]: ERROR neutron     raise RuntimeError(msg, last_err)
[  491.085962] env[62095]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  491.085962] env[62095]: ERROR neutron 
[  493.395728] env[62144]: INFO neutron.common.config [-] Logging enabled!
[  493.396377] env[62144]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  493.396857] env[62144]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=62144) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  493.397187] env[62144]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  493.397376] env[62144]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  493.398262] env[62144]: WARNING oslo_policy.policy [None req-33a13dc3-aa0d-41cd-a2ee-0af4fe79fae5 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  493.398600] env[62144]: WARNING oslo_policy.policy [None req-33a13dc3-aa0d-41cd-a2ee-0af4fe79fae5 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  493.399919] env[62144]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-33a13dc3-aa0d-41cd-a2ee-0af4fe79fae5 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  493.413892] env[62144]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-33a13dc3-aa0d-41cd-a2ee-0af4fe79fae5 None None] Session token - acquiring
[  493.414719] env[62144]: DEBUG networking_nsxv3.common.locking [None req-33a13dc3-aa0d-41cd-a2ee-0af4fe79fae5 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62144) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  493.415077] env[62144]: DEBUG oslo_concurrency.lockutils [None req-33a13dc3-aa0d-41cd-a2ee-0af4fe79fae5 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  493.415311] env[62144]: DEBUG oslo_concurrency.lockutils [None req-33a13dc3-aa0d-41cd-a2ee-0af4fe79fae5 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  493.415758] env[62144]: DEBUG oslo_concurrency.lockutils [None req-33a13dc3-aa0d-41cd-a2ee-0af4fe79fae5 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  493.424643] env[62144]: DEBUG oslo_concurrency.lockutils [None req-33a13dc3-aa0d-41cd-a2ee-0af4fe79fae5 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  493.424986] env[62144]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-33a13dc3-aa0d-41cd-a2ee-0af4fe79fae5 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  493.425234] env[62144]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-33a13dc3-aa0d-41cd-a2ee-0af4fe79fae5 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=62144) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  495.431588] env[62144]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-33a13dc3-aa0d-41cd-a2ee-0af4fe79fae5 None None] Session token - acquiring
[  495.432060] env[62144]: DEBUG networking_nsxv3.common.locking [None req-33a13dc3-aa0d-41cd-a2ee-0af4fe79fae5 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62144) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  495.432334] env[62144]: DEBUG oslo_concurrency.lockutils [None req-33a13dc3-aa0d-41cd-a2ee-0af4fe79fae5 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  495.432534] env[62144]: DEBUG oslo_concurrency.lockutils [None req-33a13dc3-aa0d-41cd-a2ee-0af4fe79fae5 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  495.432925] env[62144]: DEBUG oslo_concurrency.lockutils [None req-33a13dc3-aa0d-41cd-a2ee-0af4fe79fae5 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  495.442523] env[62144]: DEBUG oslo_concurrency.lockutils [None req-33a13dc3-aa0d-41cd-a2ee-0af4fe79fae5 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  495.442826] env[62144]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-33a13dc3-aa0d-41cd-a2ee-0af4fe79fae5 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  495.443036] env[62144]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-33a13dc3-aa0d-41cd-a2ee-0af4fe79fae5 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=62144) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  497.446001] env[62144]: CRITICAL neutron [None req-33a13dc3-aa0d-41cd-a2ee-0af4fe79fae5 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  497.446001] env[62144]: ERROR neutron Traceback (most recent call last):
[  497.446001] env[62144]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  497.446001] env[62144]: ERROR neutron     sys.exit(main())
[  497.446001] env[62144]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  497.446001] env[62144]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  497.446001] env[62144]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  497.446001] env[62144]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  497.446001] env[62144]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  497.446001] env[62144]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  497.446001] env[62144]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  497.446001] env[62144]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  497.446001] env[62144]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  497.446001] env[62144]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  497.446001] env[62144]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  497.446001] env[62144]: ERROR neutron     response = self.get(path=path, params=params)
[  497.446806] env[62144]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  497.446806] env[62144]: ERROR neutron     raise RuntimeError(msg, last_err)
[  497.446806] env[62144]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  497.446806] env[62144]: ERROR neutron 
[  499.782417] env[62150]: INFO neutron.common.config [-] Logging enabled!
[  499.782825] env[62150]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  499.782920] env[62150]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=62150) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  499.783141] env[62150]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  499.783233] env[62150]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  499.784081] env[62150]: WARNING oslo_policy.policy [None req-ebccf20c-834e-4b1e-a2ea-52d7431740d0 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  499.784316] env[62150]: WARNING oslo_policy.policy [None req-ebccf20c-834e-4b1e-a2ea-52d7431740d0 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  499.785504] env[62150]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-ebccf20c-834e-4b1e-a2ea-52d7431740d0 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  499.799539] env[62150]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ebccf20c-834e-4b1e-a2ea-52d7431740d0 None None] Session token - acquiring
[  499.800357] env[62150]: DEBUG networking_nsxv3.common.locking [None req-ebccf20c-834e-4b1e-a2ea-52d7431740d0 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62150) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  499.800549] env[62150]: DEBUG oslo_concurrency.lockutils [None req-ebccf20c-834e-4b1e-a2ea-52d7431740d0 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62150) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  499.800673] env[62150]: DEBUG oslo_concurrency.lockutils [None req-ebccf20c-834e-4b1e-a2ea-52d7431740d0 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62150) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  499.801054] env[62150]: DEBUG oslo_concurrency.lockutils [None req-ebccf20c-834e-4b1e-a2ea-52d7431740d0 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62150) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  499.809990] env[62150]: DEBUG oslo_concurrency.lockutils [None req-ebccf20c-834e-4b1e-a2ea-52d7431740d0 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62150) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  499.810232] env[62150]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ebccf20c-834e-4b1e-a2ea-52d7431740d0 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  499.810389] env[62150]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ebccf20c-834e-4b1e-a2ea-52d7431740d0 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=62150) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  501.816278] env[62150]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ebccf20c-834e-4b1e-a2ea-52d7431740d0 None None] Session token - acquiring
[  501.816645] env[62150]: DEBUG networking_nsxv3.common.locking [None req-ebccf20c-834e-4b1e-a2ea-52d7431740d0 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62150) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  501.816782] env[62150]: DEBUG oslo_concurrency.lockutils [None req-ebccf20c-834e-4b1e-a2ea-52d7431740d0 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62150) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  501.816908] env[62150]: DEBUG oslo_concurrency.lockutils [None req-ebccf20c-834e-4b1e-a2ea-52d7431740d0 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62150) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  501.817185] env[62150]: DEBUG oslo_concurrency.lockutils [None req-ebccf20c-834e-4b1e-a2ea-52d7431740d0 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62150) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  501.826539] env[62150]: DEBUG oslo_concurrency.lockutils [None req-ebccf20c-834e-4b1e-a2ea-52d7431740d0 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62150) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  501.826774] env[62150]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ebccf20c-834e-4b1e-a2ea-52d7431740d0 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  501.826914] env[62150]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ebccf20c-834e-4b1e-a2ea-52d7431740d0 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=62150) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  503.828888] env[62150]: CRITICAL neutron [None req-ebccf20c-834e-4b1e-a2ea-52d7431740d0 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  503.828888] env[62150]: ERROR neutron Traceback (most recent call last):
[  503.828888] env[62150]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  503.828888] env[62150]: ERROR neutron     sys.exit(main())
[  503.828888] env[62150]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  503.828888] env[62150]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  503.828888] env[62150]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  503.828888] env[62150]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  503.828888] env[62150]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  503.828888] env[62150]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  503.828888] env[62150]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  503.828888] env[62150]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  503.828888] env[62150]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  503.828888] env[62150]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  503.828888] env[62150]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  503.828888] env[62150]: ERROR neutron     response = self.get(path=path, params=params)
[  503.829515] env[62150]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  503.829515] env[62150]: ERROR neutron     raise RuntimeError(msg, last_err)
[  503.829515] env[62150]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  503.829515] env[62150]: ERROR neutron 
[  506.585683] env[62384]: INFO neutron.common.config [-] Logging enabled!
[  506.585995] env[62384]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  506.586213] env[62384]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=62384) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  506.586450] env[62384]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  506.586717] env[62384]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  506.587408] env[62384]: WARNING oslo_policy.policy [None req-85a21f0c-8848-48d2-8987-58f98318a259 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  506.587695] env[62384]: WARNING oslo_policy.policy [None req-85a21f0c-8848-48d2-8987-58f98318a259 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  506.588922] env[62384]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-85a21f0c-8848-48d2-8987-58f98318a259 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  506.610327] env[62384]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-85a21f0c-8848-48d2-8987-58f98318a259 None None] Session token - acquiring
[  506.611224] env[62384]: DEBUG networking_nsxv3.common.locking [None req-85a21f0c-8848-48d2-8987-58f98318a259 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62384) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  506.611430] env[62384]: DEBUG oslo_concurrency.lockutils [None req-85a21f0c-8848-48d2-8987-58f98318a259 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62384) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  506.611555] env[62384]: DEBUG oslo_concurrency.lockutils [None req-85a21f0c-8848-48d2-8987-58f98318a259 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62384) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  506.611919] env[62384]: DEBUG oslo_concurrency.lockutils [None req-85a21f0c-8848-48d2-8987-58f98318a259 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62384) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  506.622194] env[62384]: DEBUG oslo_concurrency.lockutils [None req-85a21f0c-8848-48d2-8987-58f98318a259 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62384) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  506.622458] env[62384]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-85a21f0c-8848-48d2-8987-58f98318a259 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  506.622599] env[62384]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-85a21f0c-8848-48d2-8987-58f98318a259 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=62384) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  508.628960] env[62384]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-85a21f0c-8848-48d2-8987-58f98318a259 None None] Session token - acquiring
[  508.629346] env[62384]: DEBUG networking_nsxv3.common.locking [None req-85a21f0c-8848-48d2-8987-58f98318a259 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62384) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  508.629474] env[62384]: DEBUG oslo_concurrency.lockutils [None req-85a21f0c-8848-48d2-8987-58f98318a259 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62384) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  508.629596] env[62384]: DEBUG oslo_concurrency.lockutils [None req-85a21f0c-8848-48d2-8987-58f98318a259 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62384) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  508.629888] env[62384]: DEBUG oslo_concurrency.lockutils [None req-85a21f0c-8848-48d2-8987-58f98318a259 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62384) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  508.647215] env[62384]: DEBUG oslo_concurrency.lockutils [None req-85a21f0c-8848-48d2-8987-58f98318a259 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62384) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  508.647457] env[62384]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-85a21f0c-8848-48d2-8987-58f98318a259 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  508.647605] env[62384]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-85a21f0c-8848-48d2-8987-58f98318a259 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=62384) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  510.648898] env[62384]: CRITICAL neutron [None req-85a21f0c-8848-48d2-8987-58f98318a259 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  510.648898] env[62384]: ERROR neutron Traceback (most recent call last):
[  510.648898] env[62384]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  510.648898] env[62384]: ERROR neutron     sys.exit(main())
[  510.648898] env[62384]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  510.648898] env[62384]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  510.648898] env[62384]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  510.648898] env[62384]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  510.648898] env[62384]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  510.648898] env[62384]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  510.648898] env[62384]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  510.648898] env[62384]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  510.648898] env[62384]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  510.648898] env[62384]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  510.648898] env[62384]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  510.648898] env[62384]: ERROR neutron     response = self.get(path=path, params=params)
[  510.649613] env[62384]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  510.649613] env[62384]: ERROR neutron     raise RuntimeError(msg, last_err)
[  510.649613] env[62384]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  510.649613] env[62384]: ERROR neutron 
[  513.410137] env[62897]: INFO neutron.common.config [-] Logging enabled!
[  513.410397] env[62897]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  513.410736] env[62897]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=62897) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  513.410942] env[62897]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  513.411039] env[62897]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  513.411874] env[62897]: WARNING oslo_policy.policy [None req-29cde5b2-5fa3-4fc6-a33c-08672b155409 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  513.412130] env[62897]: WARNING oslo_policy.policy [None req-29cde5b2-5fa3-4fc6-a33c-08672b155409 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  513.413412] env[62897]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-29cde5b2-5fa3-4fc6-a33c-08672b155409 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  513.427818] env[62897]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-29cde5b2-5fa3-4fc6-a33c-08672b155409 None None] Session token - acquiring
[  513.428707] env[62897]: DEBUG networking_nsxv3.common.locking [None req-29cde5b2-5fa3-4fc6-a33c-08672b155409 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62897) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  513.428913] env[62897]: DEBUG oslo_concurrency.lockutils [None req-29cde5b2-5fa3-4fc6-a33c-08672b155409 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62897) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  513.429038] env[62897]: DEBUG oslo_concurrency.lockutils [None req-29cde5b2-5fa3-4fc6-a33c-08672b155409 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62897) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  513.429403] env[62897]: DEBUG oslo_concurrency.lockutils [None req-29cde5b2-5fa3-4fc6-a33c-08672b155409 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62897) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  513.438973] env[62897]: DEBUG oslo_concurrency.lockutils [None req-29cde5b2-5fa3-4fc6-a33c-08672b155409 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62897) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  513.439264] env[62897]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-29cde5b2-5fa3-4fc6-a33c-08672b155409 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  513.439461] env[62897]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-29cde5b2-5fa3-4fc6-a33c-08672b155409 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=62897) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  515.445446] env[62897]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-29cde5b2-5fa3-4fc6-a33c-08672b155409 None None] Session token - acquiring
[  515.445824] env[62897]: DEBUG networking_nsxv3.common.locking [None req-29cde5b2-5fa3-4fc6-a33c-08672b155409 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62897) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  515.446023] env[62897]: DEBUG oslo_concurrency.lockutils [None req-29cde5b2-5fa3-4fc6-a33c-08672b155409 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62897) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  515.446159] env[62897]: DEBUG oslo_concurrency.lockutils [None req-29cde5b2-5fa3-4fc6-a33c-08672b155409 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62897) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  515.446441] env[62897]: DEBUG oslo_concurrency.lockutils [None req-29cde5b2-5fa3-4fc6-a33c-08672b155409 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62897) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  515.456142] env[62897]: DEBUG oslo_concurrency.lockutils [None req-29cde5b2-5fa3-4fc6-a33c-08672b155409 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62897) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  515.456413] env[62897]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-29cde5b2-5fa3-4fc6-a33c-08672b155409 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  515.456552] env[62897]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-29cde5b2-5fa3-4fc6-a33c-08672b155409 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=62897) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  517.460273] env[62897]: CRITICAL neutron [None req-29cde5b2-5fa3-4fc6-a33c-08672b155409 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  517.460273] env[62897]: ERROR neutron Traceback (most recent call last):
[  517.460273] env[62897]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  517.460273] env[62897]: ERROR neutron     sys.exit(main())
[  517.460273] env[62897]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  517.460273] env[62897]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  517.460273] env[62897]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  517.460273] env[62897]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  517.460273] env[62897]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  517.460273] env[62897]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  517.460273] env[62897]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  517.460273] env[62897]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  517.460273] env[62897]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  517.460273] env[62897]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  517.460273] env[62897]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  517.460273] env[62897]: ERROR neutron     response = self.get(path=path, params=params)
[  517.461019] env[62897]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  517.461019] env[62897]: ERROR neutron     raise RuntimeError(msg, last_err)
[  517.461019] env[62897]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  517.461019] env[62897]: ERROR neutron 
[  520.397054] env[63373]: INFO neutron.common.config [-] Logging enabled!
[  520.397298] env[63373]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  520.397583] env[63373]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=63373) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  520.397857] env[63373]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  520.397958] env[63373]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  520.398809] env[63373]: WARNING oslo_policy.policy [None req-17484ef2-62f1-49d0-b60b-bc01696703fa None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  520.399324] env[63373]: WARNING oslo_policy.policy [None req-17484ef2-62f1-49d0-b60b-bc01696703fa None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  520.400349] env[63373]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-17484ef2-62f1-49d0-b60b-bc01696703fa None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  520.414987] env[63373]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-17484ef2-62f1-49d0-b60b-bc01696703fa None None] Session token - acquiring
[  520.415913] env[63373]: DEBUG networking_nsxv3.common.locking [None req-17484ef2-62f1-49d0-b60b-bc01696703fa None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=63373) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  520.416271] env[63373]: DEBUG oslo_concurrency.lockutils [None req-17484ef2-62f1-49d0-b60b-bc01696703fa None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=63373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  520.416271] env[63373]: DEBUG oslo_concurrency.lockutils [None req-17484ef2-62f1-49d0-b60b-bc01696703fa None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=63373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  520.416626] env[63373]: DEBUG oslo_concurrency.lockutils [None req-17484ef2-62f1-49d0-b60b-bc01696703fa None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=63373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  520.426387] env[63373]: DEBUG oslo_concurrency.lockutils [None req-17484ef2-62f1-49d0-b60b-bc01696703fa None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=63373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  520.426387] env[63373]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-17484ef2-62f1-49d0-b60b-bc01696703fa None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  520.426387] env[63373]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-17484ef2-62f1-49d0-b60b-bc01696703fa None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=63373) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  522.433970] env[63373]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-17484ef2-62f1-49d0-b60b-bc01696703fa None None] Session token - acquiring
[  522.434398] env[63373]: DEBUG networking_nsxv3.common.locking [None req-17484ef2-62f1-49d0-b60b-bc01696703fa None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=63373) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  522.434545] env[63373]: DEBUG oslo_concurrency.lockutils [None req-17484ef2-62f1-49d0-b60b-bc01696703fa None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=63373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  522.434676] env[63373]: DEBUG oslo_concurrency.lockutils [None req-17484ef2-62f1-49d0-b60b-bc01696703fa None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=63373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  522.434987] env[63373]: DEBUG oslo_concurrency.lockutils [None req-17484ef2-62f1-49d0-b60b-bc01696703fa None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=63373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  522.447983] env[63373]: DEBUG oslo_concurrency.lockutils [None req-17484ef2-62f1-49d0-b60b-bc01696703fa None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=63373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  522.448267] env[63373]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-17484ef2-62f1-49d0-b60b-bc01696703fa None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  522.448408] env[63373]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-17484ef2-62f1-49d0-b60b-bc01696703fa None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=63373) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  524.451351] env[63373]: CRITICAL neutron [None req-17484ef2-62f1-49d0-b60b-bc01696703fa None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  524.451351] env[63373]: ERROR neutron Traceback (most recent call last):
[  524.451351] env[63373]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  524.451351] env[63373]: ERROR neutron     sys.exit(main())
[  524.451351] env[63373]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  524.451351] env[63373]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  524.451351] env[63373]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  524.451351] env[63373]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  524.451351] env[63373]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  524.451351] env[63373]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  524.451351] env[63373]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  524.451351] env[63373]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  524.451351] env[63373]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  524.451351] env[63373]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  524.451351] env[63373]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  524.451351] env[63373]: ERROR neutron     response = self.get(path=path, params=params)
[  524.452145] env[63373]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  524.452145] env[63373]: ERROR neutron     raise RuntimeError(msg, last_err)
[  524.452145] env[63373]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  524.452145] env[63373]: ERROR neutron 
[  527.372911] env[63986]: INFO neutron.common.config [-] Logging enabled!
[  527.373160] env[63986]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  527.373688] env[63986]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=63986) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  527.373884] env[63986]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  527.373987] env[63986]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  527.374863] env[63986]: WARNING oslo_policy.policy [None req-2b8a4787-1e87-496f-a6c2-7e30fe6e2cac None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  527.375100] env[63986]: WARNING oslo_policy.policy [None req-2b8a4787-1e87-496f-a6c2-7e30fe6e2cac None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  527.376368] env[63986]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-2b8a4787-1e87-496f-a6c2-7e30fe6e2cac None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  527.393284] env[63986]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-2b8a4787-1e87-496f-a6c2-7e30fe6e2cac None None] Session token - acquiring
[  527.394478] env[63986]: DEBUG networking_nsxv3.common.locking [None req-2b8a4787-1e87-496f-a6c2-7e30fe6e2cac None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=63986) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  527.394996] env[63986]: DEBUG oslo_concurrency.lockutils [None req-2b8a4787-1e87-496f-a6c2-7e30fe6e2cac None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=63986) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  527.395252] env[63986]: DEBUG oslo_concurrency.lockutils [None req-2b8a4787-1e87-496f-a6c2-7e30fe6e2cac None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=63986) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  527.395720] env[63986]: DEBUG oslo_concurrency.lockutils [None req-2b8a4787-1e87-496f-a6c2-7e30fe6e2cac None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=63986) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  527.406198] env[63986]: DEBUG oslo_concurrency.lockutils [None req-2b8a4787-1e87-496f-a6c2-7e30fe6e2cac None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=63986) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  527.406388] env[63986]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-2b8a4787-1e87-496f-a6c2-7e30fe6e2cac None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  527.406532] env[63986]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-2b8a4787-1e87-496f-a6c2-7e30fe6e2cac None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=63986) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  529.415153] env[63986]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-2b8a4787-1e87-496f-a6c2-7e30fe6e2cac None None] Session token - acquiring
[  529.415531] env[63986]: DEBUG networking_nsxv3.common.locking [None req-2b8a4787-1e87-496f-a6c2-7e30fe6e2cac None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=63986) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  529.415726] env[63986]: DEBUG oslo_concurrency.lockutils [None req-2b8a4787-1e87-496f-a6c2-7e30fe6e2cac None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=63986) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  529.415848] env[63986]: DEBUG oslo_concurrency.lockutils [None req-2b8a4787-1e87-496f-a6c2-7e30fe6e2cac None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=63986) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  529.416126] env[63986]: DEBUG oslo_concurrency.lockutils [None req-2b8a4787-1e87-496f-a6c2-7e30fe6e2cac None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=63986) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  529.426496] env[63986]: DEBUG oslo_concurrency.lockutils [None req-2b8a4787-1e87-496f-a6c2-7e30fe6e2cac None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=63986) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  529.426496] env[63986]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-2b8a4787-1e87-496f-a6c2-7e30fe6e2cac None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  529.426496] env[63986]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-2b8a4787-1e87-496f-a6c2-7e30fe6e2cac None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=63986) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  531.433238] env[63986]: CRITICAL neutron [None req-2b8a4787-1e87-496f-a6c2-7e30fe6e2cac None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  531.433238] env[63986]: ERROR neutron Traceback (most recent call last):
[  531.433238] env[63986]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  531.433238] env[63986]: ERROR neutron     sys.exit(main())
[  531.433238] env[63986]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  531.433238] env[63986]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  531.433238] env[63986]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  531.433238] env[63986]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  531.433238] env[63986]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  531.433238] env[63986]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  531.433238] env[63986]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  531.433238] env[63986]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  531.433238] env[63986]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  531.433238] env[63986]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  531.433238] env[63986]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  531.433238] env[63986]: ERROR neutron     response = self.get(path=path, params=params)
[  531.433846] env[63986]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  531.433846] env[63986]: ERROR neutron     raise RuntimeError(msg, last_err)
[  531.433846] env[63986]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  531.433846] env[63986]: ERROR neutron 
[  534.384806] env[64551]: INFO neutron.common.config [-] Logging enabled!
[  534.385324] env[64551]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  534.385860] env[64551]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=64551) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  534.386224] env[64551]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  534.386476] env[64551]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  534.387488] env[64551]: WARNING oslo_policy.policy [None req-adae0385-b32a-44b1-b38e-67b8a7255e28 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  534.387836] env[64551]: WARNING oslo_policy.policy [None req-adae0385-b32a-44b1-b38e-67b8a7255e28 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  534.389271] env[64551]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-adae0385-b32a-44b1-b38e-67b8a7255e28 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  534.416404] env[64551]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-adae0385-b32a-44b1-b38e-67b8a7255e28 None None] Session token - acquiring
[  534.417313] env[64551]: DEBUG networking_nsxv3.common.locking [None req-adae0385-b32a-44b1-b38e-67b8a7255e28 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=64551) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  534.417522] env[64551]: DEBUG oslo_concurrency.lockutils [None req-adae0385-b32a-44b1-b38e-67b8a7255e28 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=64551) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  534.417646] env[64551]: DEBUG oslo_concurrency.lockutils [None req-adae0385-b32a-44b1-b38e-67b8a7255e28 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=64551) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  534.418066] env[64551]: DEBUG oslo_concurrency.lockutils [None req-adae0385-b32a-44b1-b38e-67b8a7255e28 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=64551) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  534.429663] env[64551]: DEBUG oslo_concurrency.lockutils [None req-adae0385-b32a-44b1-b38e-67b8a7255e28 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=64551) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  534.429886] env[64551]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-adae0385-b32a-44b1-b38e-67b8a7255e28 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  534.430104] env[64551]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-adae0385-b32a-44b1-b38e-67b8a7255e28 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=64551) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  536.436435] env[64551]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-adae0385-b32a-44b1-b38e-67b8a7255e28 None None] Session token - acquiring
[  536.436752] env[64551]: DEBUG networking_nsxv3.common.locking [None req-adae0385-b32a-44b1-b38e-67b8a7255e28 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=64551) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  536.437018] env[64551]: DEBUG oslo_concurrency.lockutils [None req-adae0385-b32a-44b1-b38e-67b8a7255e28 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=64551) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  536.437196] env[64551]: DEBUG oslo_concurrency.lockutils [None req-adae0385-b32a-44b1-b38e-67b8a7255e28 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=64551) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  536.437561] env[64551]: DEBUG oslo_concurrency.lockutils [None req-adae0385-b32a-44b1-b38e-67b8a7255e28 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=64551) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  536.447151] env[64551]: DEBUG oslo_concurrency.lockutils [None req-adae0385-b32a-44b1-b38e-67b8a7255e28 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=64551) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  536.447408] env[64551]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-adae0385-b32a-44b1-b38e-67b8a7255e28 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  536.447548] env[64551]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-adae0385-b32a-44b1-b38e-67b8a7255e28 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=64551) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  538.448886] env[64551]: CRITICAL neutron [None req-adae0385-b32a-44b1-b38e-67b8a7255e28 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  538.448886] env[64551]: ERROR neutron Traceback (most recent call last):
[  538.448886] env[64551]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  538.448886] env[64551]: ERROR neutron     sys.exit(main())
[  538.448886] env[64551]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  538.448886] env[64551]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  538.448886] env[64551]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  538.448886] env[64551]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  538.448886] env[64551]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  538.448886] env[64551]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  538.448886] env[64551]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  538.448886] env[64551]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  538.448886] env[64551]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  538.448886] env[64551]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  538.448886] env[64551]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  538.448886] env[64551]: ERROR neutron     response = self.get(path=path, params=params)
[  538.449562] env[64551]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  538.449562] env[64551]: ERROR neutron     raise RuntimeError(msg, last_err)
[  538.449562] env[64551]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  538.449562] env[64551]: ERROR neutron 
[  541.307697] env[64953]: INFO neutron.common.config [-] Logging enabled!
[  541.307947] env[64953]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  541.308282] env[64953]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=64953) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  541.308558] env[64953]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  541.308650] env[64953]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  541.309507] env[64953]: WARNING oslo_policy.policy [None req-72c30075-28d3-4e2d-83d6-162fb3f46472 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  541.309984] env[64953]: WARNING oslo_policy.policy [None req-72c30075-28d3-4e2d-83d6-162fb3f46472 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  541.311015] env[64953]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-72c30075-28d3-4e2d-83d6-162fb3f46472 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  541.326366] env[64953]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-72c30075-28d3-4e2d-83d6-162fb3f46472 None None] Session token - acquiring
[  541.326366] env[64953]: DEBUG networking_nsxv3.common.locking [None req-72c30075-28d3-4e2d-83d6-162fb3f46472 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=64953) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  541.326584] env[64953]: DEBUG oslo_concurrency.lockutils [None req-72c30075-28d3-4e2d-83d6-162fb3f46472 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=64953) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  541.326709] env[64953]: DEBUG oslo_concurrency.lockutils [None req-72c30075-28d3-4e2d-83d6-162fb3f46472 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=64953) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  541.327091] env[64953]: DEBUG oslo_concurrency.lockutils [None req-72c30075-28d3-4e2d-83d6-162fb3f46472 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=64953) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  541.336498] env[64953]: DEBUG oslo_concurrency.lockutils [None req-72c30075-28d3-4e2d-83d6-162fb3f46472 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=64953) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  541.336693] env[64953]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-72c30075-28d3-4e2d-83d6-162fb3f46472 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  541.336834] env[64953]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-72c30075-28d3-4e2d-83d6-162fb3f46472 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=64953) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  543.343055] env[64953]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-72c30075-28d3-4e2d-83d6-162fb3f46472 None None] Session token - acquiring
[  543.343459] env[64953]: DEBUG networking_nsxv3.common.locking [None req-72c30075-28d3-4e2d-83d6-162fb3f46472 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=64953) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  543.343770] env[64953]: DEBUG oslo_concurrency.lockutils [None req-72c30075-28d3-4e2d-83d6-162fb3f46472 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=64953) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  543.343841] env[64953]: DEBUG oslo_concurrency.lockutils [None req-72c30075-28d3-4e2d-83d6-162fb3f46472 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=64953) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  543.344111] env[64953]: DEBUG oslo_concurrency.lockutils [None req-72c30075-28d3-4e2d-83d6-162fb3f46472 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=64953) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  543.354173] env[64953]: DEBUG oslo_concurrency.lockutils [None req-72c30075-28d3-4e2d-83d6-162fb3f46472 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=64953) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  543.354437] env[64953]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-72c30075-28d3-4e2d-83d6-162fb3f46472 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  543.354578] env[64953]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-72c30075-28d3-4e2d-83d6-162fb3f46472 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=64953) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  545.356944] env[64953]: CRITICAL neutron [None req-72c30075-28d3-4e2d-83d6-162fb3f46472 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  545.356944] env[64953]: ERROR neutron Traceback (most recent call last):
[  545.356944] env[64953]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  545.356944] env[64953]: ERROR neutron     sys.exit(main())
[  545.356944] env[64953]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  545.356944] env[64953]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  545.356944] env[64953]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  545.356944] env[64953]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  545.356944] env[64953]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  545.356944] env[64953]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  545.356944] env[64953]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  545.356944] env[64953]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  545.356944] env[64953]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  545.356944] env[64953]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  545.356944] env[64953]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  545.356944] env[64953]: ERROR neutron     response = self.get(path=path, params=params)
[  545.357744] env[64953]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  545.357744] env[64953]: ERROR neutron     raise RuntimeError(msg, last_err)
[  545.357744] env[64953]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  545.357744] env[64953]: ERROR neutron 
[  548.595231] env[65401]: INFO neutron.common.config [-] Logging enabled!
[  548.595488] env[65401]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  548.595810] env[65401]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=65401) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  548.596437] env[65401]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  548.596437] env[65401]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  548.597119] env[65401]: WARNING oslo_policy.policy [None req-5525254c-691d-477a-a711-793d49a6cf71 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  548.597351] env[65401]: WARNING oslo_policy.policy [None req-5525254c-691d-477a-a711-793d49a6cf71 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  548.598744] env[65401]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-5525254c-691d-477a-a711-793d49a6cf71 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  548.613969] env[65401]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5525254c-691d-477a-a711-793d49a6cf71 None None] Session token - acquiring
[  548.614863] env[65401]: DEBUG networking_nsxv3.common.locking [None req-5525254c-691d-477a-a711-793d49a6cf71 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=65401) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  548.615068] env[65401]: DEBUG oslo_concurrency.lockutils [None req-5525254c-691d-477a-a711-793d49a6cf71 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65401) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  548.615191] env[65401]: DEBUG oslo_concurrency.lockutils [None req-5525254c-691d-477a-a711-793d49a6cf71 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65401) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  548.615575] env[65401]: DEBUG oslo_concurrency.lockutils [None req-5525254c-691d-477a-a711-793d49a6cf71 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65401) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  548.626495] env[65401]: DEBUG oslo_concurrency.lockutils [None req-5525254c-691d-477a-a711-793d49a6cf71 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65401) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  548.628812] env[65401]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5525254c-691d-477a-a711-793d49a6cf71 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  548.629152] env[65401]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5525254c-691d-477a-a711-793d49a6cf71 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=65401) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  550.635316] env[65401]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5525254c-691d-477a-a711-793d49a6cf71 None None] Session token - acquiring
[  550.635734] env[65401]: DEBUG networking_nsxv3.common.locking [None req-5525254c-691d-477a-a711-793d49a6cf71 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=65401) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  550.635884] env[65401]: DEBUG oslo_concurrency.lockutils [None req-5525254c-691d-477a-a711-793d49a6cf71 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65401) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  550.636048] env[65401]: DEBUG oslo_concurrency.lockutils [None req-5525254c-691d-477a-a711-793d49a6cf71 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65401) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  550.636817] env[65401]: DEBUG oslo_concurrency.lockutils [None req-5525254c-691d-477a-a711-793d49a6cf71 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65401) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  550.646179] env[65401]: DEBUG oslo_concurrency.lockutils [None req-5525254c-691d-477a-a711-793d49a6cf71 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65401) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  550.646564] env[65401]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5525254c-691d-477a-a711-793d49a6cf71 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  550.646816] env[65401]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5525254c-691d-477a-a711-793d49a6cf71 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=65401) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  552.656203] env[65401]: CRITICAL neutron [None req-5525254c-691d-477a-a711-793d49a6cf71 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  552.656203] env[65401]: ERROR neutron Traceback (most recent call last):
[  552.656203] env[65401]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  552.656203] env[65401]: ERROR neutron     sys.exit(main())
[  552.656203] env[65401]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  552.656203] env[65401]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  552.656203] env[65401]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  552.656203] env[65401]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  552.656203] env[65401]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  552.656203] env[65401]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  552.656203] env[65401]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  552.656203] env[65401]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  552.656203] env[65401]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  552.656203] env[65401]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  552.656203] env[65401]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  552.656203] env[65401]: ERROR neutron     response = self.get(path=path, params=params)
[  552.656902] env[65401]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  552.656902] env[65401]: ERROR neutron     raise RuntimeError(msg, last_err)
[  552.656902] env[65401]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  552.656902] env[65401]: ERROR neutron 
[  555.670350] env[65695]: INFO neutron.common.config [-] Logging enabled!
[  555.670622] env[65695]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  555.670960] env[65695]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=65695) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  555.671198] env[65695]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  555.671362] env[65695]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  555.672239] env[65695]: WARNING oslo_policy.policy [None req-052f24fa-1e54-4f98-bd6d-522b44abe517 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  555.672452] env[65695]: WARNING oslo_policy.policy [None req-052f24fa-1e54-4f98-bd6d-522b44abe517 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  555.673767] env[65695]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-052f24fa-1e54-4f98-bd6d-522b44abe517 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  555.689715] env[65695]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-052f24fa-1e54-4f98-bd6d-522b44abe517 None None] Session token - acquiring
[  555.690626] env[65695]: DEBUG networking_nsxv3.common.locking [None req-052f24fa-1e54-4f98-bd6d-522b44abe517 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=65695) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  555.690866] env[65695]: DEBUG oslo_concurrency.lockutils [None req-052f24fa-1e54-4f98-bd6d-522b44abe517 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65695) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  555.691017] env[65695]: DEBUG oslo_concurrency.lockutils [None req-052f24fa-1e54-4f98-bd6d-522b44abe517 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65695) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  555.691415] env[65695]: DEBUG oslo_concurrency.lockutils [None req-052f24fa-1e54-4f98-bd6d-522b44abe517 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65695) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  555.710408] env[65695]: DEBUG oslo_concurrency.lockutils [None req-052f24fa-1e54-4f98-bd6d-522b44abe517 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65695) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  555.710704] env[65695]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-052f24fa-1e54-4f98-bd6d-522b44abe517 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  555.711122] env[65695]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-052f24fa-1e54-4f98-bd6d-522b44abe517 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=65695) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  557.717376] env[65695]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-052f24fa-1e54-4f98-bd6d-522b44abe517 None None] Session token - acquiring
[  557.717758] env[65695]: DEBUG networking_nsxv3.common.locking [None req-052f24fa-1e54-4f98-bd6d-522b44abe517 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=65695) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  557.718129] env[65695]: DEBUG oslo_concurrency.lockutils [None req-052f24fa-1e54-4f98-bd6d-522b44abe517 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65695) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  557.718188] env[65695]: DEBUG oslo_concurrency.lockutils [None req-052f24fa-1e54-4f98-bd6d-522b44abe517 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65695) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  557.718453] env[65695]: DEBUG oslo_concurrency.lockutils [None req-052f24fa-1e54-4f98-bd6d-522b44abe517 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65695) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  557.751037] env[65695]: DEBUG oslo_concurrency.lockutils [None req-052f24fa-1e54-4f98-bd6d-522b44abe517 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65695) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  557.754176] env[65695]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-052f24fa-1e54-4f98-bd6d-522b44abe517 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  557.754176] env[65695]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-052f24fa-1e54-4f98-bd6d-522b44abe517 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=65695) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  559.756461] env[65695]: CRITICAL neutron [None req-052f24fa-1e54-4f98-bd6d-522b44abe517 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  559.756461] env[65695]: ERROR neutron Traceback (most recent call last):
[  559.756461] env[65695]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  559.756461] env[65695]: ERROR neutron     sys.exit(main())
[  559.756461] env[65695]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  559.756461] env[65695]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  559.756461] env[65695]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  559.756461] env[65695]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  559.756461] env[65695]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  559.756461] env[65695]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  559.756461] env[65695]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  559.756461] env[65695]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  559.756461] env[65695]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  559.756461] env[65695]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  559.756461] env[65695]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  559.756461] env[65695]: ERROR neutron     response = self.get(path=path, params=params)
[  559.757272] env[65695]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  559.757272] env[65695]: ERROR neutron     raise RuntimeError(msg, last_err)
[  559.757272] env[65695]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  559.757272] env[65695]: ERROR neutron 
[  562.665918] env[66259]: INFO neutron.common.config [-] Logging enabled!
[  562.666203] env[66259]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  562.666503] env[66259]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=66259) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  562.666700] env[66259]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  562.666789] env[66259]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  562.667766] env[66259]: WARNING oslo_policy.policy [None req-460ce247-15cd-44c1-8e0c-2b3ae10a9dfb None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  562.667915] env[66259]: WARNING oslo_policy.policy [None req-460ce247-15cd-44c1-8e0c-2b3ae10a9dfb None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  562.669208] env[66259]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-460ce247-15cd-44c1-8e0c-2b3ae10a9dfb None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  562.683831] env[66259]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-460ce247-15cd-44c1-8e0c-2b3ae10a9dfb None None] Session token - acquiring
[  562.686943] env[66259]: DEBUG networking_nsxv3.common.locking [None req-460ce247-15cd-44c1-8e0c-2b3ae10a9dfb None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=66259) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  562.686943] env[66259]: DEBUG oslo_concurrency.lockutils [None req-460ce247-15cd-44c1-8e0c-2b3ae10a9dfb None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66259) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  562.687640] env[66259]: DEBUG oslo_concurrency.lockutils [None req-460ce247-15cd-44c1-8e0c-2b3ae10a9dfb None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66259) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  562.687640] env[66259]: DEBUG oslo_concurrency.lockutils [None req-460ce247-15cd-44c1-8e0c-2b3ae10a9dfb None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66259) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  562.696860] env[66259]: DEBUG oslo_concurrency.lockutils [None req-460ce247-15cd-44c1-8e0c-2b3ae10a9dfb None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66259) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  562.697353] env[66259]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-460ce247-15cd-44c1-8e0c-2b3ae10a9dfb None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  562.697518] env[66259]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-460ce247-15cd-44c1-8e0c-2b3ae10a9dfb None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=66259) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  564.705628] env[66259]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-460ce247-15cd-44c1-8e0c-2b3ae10a9dfb None None] Session token - acquiring
[  564.706101] env[66259]: DEBUG networking_nsxv3.common.locking [None req-460ce247-15cd-44c1-8e0c-2b3ae10a9dfb None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=66259) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  564.706343] env[66259]: DEBUG oslo_concurrency.lockutils [None req-460ce247-15cd-44c1-8e0c-2b3ae10a9dfb None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66259) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  564.706490] env[66259]: DEBUG oslo_concurrency.lockutils [None req-460ce247-15cd-44c1-8e0c-2b3ae10a9dfb None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66259) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  564.706778] env[66259]: DEBUG oslo_concurrency.lockutils [None req-460ce247-15cd-44c1-8e0c-2b3ae10a9dfb None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66259) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  564.717140] env[66259]: DEBUG oslo_concurrency.lockutils [None req-460ce247-15cd-44c1-8e0c-2b3ae10a9dfb None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66259) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  564.717140] env[66259]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-460ce247-15cd-44c1-8e0c-2b3ae10a9dfb None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  564.717140] env[66259]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-460ce247-15cd-44c1-8e0c-2b3ae10a9dfb None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=66259) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  566.723437] env[66259]: CRITICAL neutron [None req-460ce247-15cd-44c1-8e0c-2b3ae10a9dfb None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  566.723437] env[66259]: ERROR neutron Traceback (most recent call last):
[  566.723437] env[66259]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  566.723437] env[66259]: ERROR neutron     sys.exit(main())
[  566.723437] env[66259]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  566.723437] env[66259]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  566.723437] env[66259]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  566.723437] env[66259]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  566.723437] env[66259]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  566.723437] env[66259]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  566.723437] env[66259]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  566.723437] env[66259]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  566.723437] env[66259]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  566.723437] env[66259]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  566.723437] env[66259]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  566.723437] env[66259]: ERROR neutron     response = self.get(path=path, params=params)
[  566.724331] env[66259]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  566.724331] env[66259]: ERROR neutron     raise RuntimeError(msg, last_err)
[  566.724331] env[66259]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  566.724331] env[66259]: ERROR neutron 
[  569.689772] env[66646]: INFO neutron.common.config [-] Logging enabled!
[  569.690105] env[66646]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  569.690438] env[66646]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=66646) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  569.690747] env[66646]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  569.690877] env[66646]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  569.692298] env[66646]: WARNING oslo_policy.policy [None req-4ec7f3b7-4db3-478f-ab66-03a6f18f57c3 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  569.692559] env[66646]: WARNING oslo_policy.policy [None req-4ec7f3b7-4db3-478f-ab66-03a6f18f57c3 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  569.693945] env[66646]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-4ec7f3b7-4db3-478f-ab66-03a6f18f57c3 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  569.709437] env[66646]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-4ec7f3b7-4db3-478f-ab66-03a6f18f57c3 None None] Session token - acquiring
[  569.710389] env[66646]: DEBUG networking_nsxv3.common.locking [None req-4ec7f3b7-4db3-478f-ab66-03a6f18f57c3 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=66646) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  569.710688] env[66646]: DEBUG oslo_concurrency.lockutils [None req-4ec7f3b7-4db3-478f-ab66-03a6f18f57c3 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  569.710738] env[66646]: DEBUG oslo_concurrency.lockutils [None req-4ec7f3b7-4db3-478f-ab66-03a6f18f57c3 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  569.711123] env[66646]: DEBUG oslo_concurrency.lockutils [None req-4ec7f3b7-4db3-478f-ab66-03a6f18f57c3 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  569.721745] env[66646]: DEBUG oslo_concurrency.lockutils [None req-4ec7f3b7-4db3-478f-ab66-03a6f18f57c3 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  569.722277] env[66646]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-4ec7f3b7-4db3-478f-ab66-03a6f18f57c3 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  569.722413] env[66646]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-4ec7f3b7-4db3-478f-ab66-03a6f18f57c3 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=66646) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  571.730031] env[66646]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-4ec7f3b7-4db3-478f-ab66-03a6f18f57c3 None None] Session token - acquiring
[  571.730383] env[66646]: DEBUG networking_nsxv3.common.locking [None req-4ec7f3b7-4db3-478f-ab66-03a6f18f57c3 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=66646) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  571.730577] env[66646]: DEBUG oslo_concurrency.lockutils [None req-4ec7f3b7-4db3-478f-ab66-03a6f18f57c3 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  571.730703] env[66646]: DEBUG oslo_concurrency.lockutils [None req-4ec7f3b7-4db3-478f-ab66-03a6f18f57c3 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  571.731019] env[66646]: DEBUG oslo_concurrency.lockutils [None req-4ec7f3b7-4db3-478f-ab66-03a6f18f57c3 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  571.744252] env[66646]: DEBUG oslo_concurrency.lockutils [None req-4ec7f3b7-4db3-478f-ab66-03a6f18f57c3 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  571.744583] env[66646]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-4ec7f3b7-4db3-478f-ab66-03a6f18f57c3 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  571.744754] env[66646]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-4ec7f3b7-4db3-478f-ab66-03a6f18f57c3 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=66646) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  573.746709] env[66646]: CRITICAL neutron [None req-4ec7f3b7-4db3-478f-ab66-03a6f18f57c3 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  573.746709] env[66646]: ERROR neutron Traceback (most recent call last):
[  573.746709] env[66646]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  573.746709] env[66646]: ERROR neutron     sys.exit(main())
[  573.746709] env[66646]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  573.746709] env[66646]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  573.746709] env[66646]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  573.746709] env[66646]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  573.746709] env[66646]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  573.746709] env[66646]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  573.746709] env[66646]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  573.746709] env[66646]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  573.746709] env[66646]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  573.746709] env[66646]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  573.746709] env[66646]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  573.746709] env[66646]: ERROR neutron     response = self.get(path=path, params=params)
[  573.747772] env[66646]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  573.747772] env[66646]: ERROR neutron     raise RuntimeError(msg, last_err)
[  573.747772] env[66646]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  573.747772] env[66646]: ERROR neutron 
[  576.774079] env[67024]: INFO neutron.common.config [-] Logging enabled!
[  576.774342] env[67024]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  576.774602] env[67024]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=67024) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  576.774833] env[67024]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  576.774936] env[67024]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  576.776625] env[67024]: WARNING oslo_policy.policy [None req-27609eb4-ff4f-4b6d-8739-8d2a50dc5a0a None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  576.776625] env[67024]: WARNING oslo_policy.policy [None req-27609eb4-ff4f-4b6d-8739-8d2a50dc5a0a None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  576.777626] env[67024]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-27609eb4-ff4f-4b6d-8739-8d2a50dc5a0a None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  576.794767] env[67024]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-27609eb4-ff4f-4b6d-8739-8d2a50dc5a0a None None] Session token - acquiring
[  576.795765] env[67024]: DEBUG networking_nsxv3.common.locking [None req-27609eb4-ff4f-4b6d-8739-8d2a50dc5a0a None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=67024) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  576.795939] env[67024]: DEBUG oslo_concurrency.lockutils [None req-27609eb4-ff4f-4b6d-8739-8d2a50dc5a0a None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67024) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  576.796096] env[67024]: DEBUG oslo_concurrency.lockutils [None req-27609eb4-ff4f-4b6d-8739-8d2a50dc5a0a None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67024) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  576.796493] env[67024]: DEBUG oslo_concurrency.lockutils [None req-27609eb4-ff4f-4b6d-8739-8d2a50dc5a0a None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67024) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  576.817199] env[67024]: DEBUG oslo_concurrency.lockutils [None req-27609eb4-ff4f-4b6d-8739-8d2a50dc5a0a None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67024) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  576.817808] env[67024]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-27609eb4-ff4f-4b6d-8739-8d2a50dc5a0a None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  576.818128] env[67024]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-27609eb4-ff4f-4b6d-8739-8d2a50dc5a0a None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=67024) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  578.825661] env[67024]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-27609eb4-ff4f-4b6d-8739-8d2a50dc5a0a None None] Session token - acquiring
[  578.826034] env[67024]: DEBUG networking_nsxv3.common.locking [None req-27609eb4-ff4f-4b6d-8739-8d2a50dc5a0a None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=67024) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  578.826255] env[67024]: DEBUG oslo_concurrency.lockutils [None req-27609eb4-ff4f-4b6d-8739-8d2a50dc5a0a None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67024) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  578.826383] env[67024]: DEBUG oslo_concurrency.lockutils [None req-27609eb4-ff4f-4b6d-8739-8d2a50dc5a0a None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67024) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  578.826744] env[67024]: DEBUG oslo_concurrency.lockutils [None req-27609eb4-ff4f-4b6d-8739-8d2a50dc5a0a None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67024) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  578.840993] env[67024]: DEBUG oslo_concurrency.lockutils [None req-27609eb4-ff4f-4b6d-8739-8d2a50dc5a0a None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67024) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  578.841485] env[67024]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-27609eb4-ff4f-4b6d-8739-8d2a50dc5a0a None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  578.841744] env[67024]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-27609eb4-ff4f-4b6d-8739-8d2a50dc5a0a None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=67024) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  580.844856] env[67024]: CRITICAL neutron [None req-27609eb4-ff4f-4b6d-8739-8d2a50dc5a0a None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  580.844856] env[67024]: ERROR neutron Traceback (most recent call last):
[  580.844856] env[67024]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  580.844856] env[67024]: ERROR neutron     sys.exit(main())
[  580.844856] env[67024]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  580.844856] env[67024]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  580.844856] env[67024]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  580.844856] env[67024]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  580.844856] env[67024]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  580.844856] env[67024]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  580.844856] env[67024]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  580.844856] env[67024]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  580.844856] env[67024]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  580.844856] env[67024]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  580.844856] env[67024]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  580.844856] env[67024]: ERROR neutron     response = self.get(path=path, params=params)
[  580.845608] env[67024]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  580.845608] env[67024]: ERROR neutron     raise RuntimeError(msg, last_err)
[  580.845608] env[67024]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  580.845608] env[67024]: ERROR neutron 
[  583.931700] env[67510]: INFO neutron.common.config [-] Logging enabled!
[  583.932093] env[67510]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  583.932195] env[67510]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=67510) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  583.932426] env[67510]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  583.932518] env[67510]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  583.933416] env[67510]: WARNING oslo_policy.policy [None req-40a6a0ca-eb76-49a6-827a-f20cffcecbf1 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  583.933617] env[67510]: WARNING oslo_policy.policy [None req-40a6a0ca-eb76-49a6-827a-f20cffcecbf1 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  583.934879] env[67510]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-40a6a0ca-eb76-49a6-827a-f20cffcecbf1 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  583.955244] env[67510]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-40a6a0ca-eb76-49a6-827a-f20cffcecbf1 None None] Session token - acquiring
[  583.964071] env[67510]: DEBUG networking_nsxv3.common.locking [None req-40a6a0ca-eb76-49a6-827a-f20cffcecbf1 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=67510) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  583.964071] env[67510]: DEBUG oslo_concurrency.lockutils [None req-40a6a0ca-eb76-49a6-827a-f20cffcecbf1 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67510) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  583.964555] env[67510]: DEBUG oslo_concurrency.lockutils [None req-40a6a0ca-eb76-49a6-827a-f20cffcecbf1 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67510) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  583.964555] env[67510]: DEBUG oslo_concurrency.lockutils [None req-40a6a0ca-eb76-49a6-827a-f20cffcecbf1 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67510) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  583.968682] env[67510]: DEBUG oslo_concurrency.lockutils [None req-40a6a0ca-eb76-49a6-827a-f20cffcecbf1 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67510) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  583.968969] env[67510]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-40a6a0ca-eb76-49a6-827a-f20cffcecbf1 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  583.969115] env[67510]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-40a6a0ca-eb76-49a6-827a-f20cffcecbf1 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=67510) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  585.975205] env[67510]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-40a6a0ca-eb76-49a6-827a-f20cffcecbf1 None None] Session token - acquiring
[  585.975562] env[67510]: DEBUG networking_nsxv3.common.locking [None req-40a6a0ca-eb76-49a6-827a-f20cffcecbf1 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=67510) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  585.975701] env[67510]: DEBUG oslo_concurrency.lockutils [None req-40a6a0ca-eb76-49a6-827a-f20cffcecbf1 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67510) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  585.975823] env[67510]: DEBUG oslo_concurrency.lockutils [None req-40a6a0ca-eb76-49a6-827a-f20cffcecbf1 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67510) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  585.976123] env[67510]: DEBUG oslo_concurrency.lockutils [None req-40a6a0ca-eb76-49a6-827a-f20cffcecbf1 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67510) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  585.985268] env[67510]: DEBUG oslo_concurrency.lockutils [None req-40a6a0ca-eb76-49a6-827a-f20cffcecbf1 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67510) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  585.985521] env[67510]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-40a6a0ca-eb76-49a6-827a-f20cffcecbf1 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  585.985660] env[67510]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-40a6a0ca-eb76-49a6-827a-f20cffcecbf1 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=67510) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  587.989695] env[67510]: CRITICAL neutron [None req-40a6a0ca-eb76-49a6-827a-f20cffcecbf1 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  587.989695] env[67510]: ERROR neutron Traceback (most recent call last):
[  587.989695] env[67510]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  587.989695] env[67510]: ERROR neutron     sys.exit(main())
[  587.989695] env[67510]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  587.989695] env[67510]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  587.989695] env[67510]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  587.989695] env[67510]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  587.989695] env[67510]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  587.989695] env[67510]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  587.989695] env[67510]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  587.989695] env[67510]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  587.989695] env[67510]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  587.989695] env[67510]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  587.989695] env[67510]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  587.989695] env[67510]: ERROR neutron     response = self.get(path=path, params=params)
[  587.990457] env[67510]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  587.990457] env[67510]: ERROR neutron     raise RuntimeError(msg, last_err)
[  587.990457] env[67510]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  587.990457] env[67510]: ERROR neutron 
[  590.937081] env[67954]: INFO neutron.common.config [-] Logging enabled!
[  590.937364] env[67954]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  590.937591] env[67954]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=67954) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  590.937831] env[67954]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  590.937931] env[67954]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  590.938925] env[67954]: WARNING oslo_policy.policy [None req-f563c51f-8a25-451b-9860-8dd4e18bcd1e None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  590.939063] env[67954]: WARNING oslo_policy.policy [None req-f563c51f-8a25-451b-9860-8dd4e18bcd1e None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  590.940363] env[67954]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-f563c51f-8a25-451b-9860-8dd4e18bcd1e None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  590.963375] env[67954]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f563c51f-8a25-451b-9860-8dd4e18bcd1e None None] Session token - acquiring
[  590.964326] env[67954]: DEBUG networking_nsxv3.common.locking [None req-f563c51f-8a25-451b-9860-8dd4e18bcd1e None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=67954) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  590.964326] env[67954]: DEBUG oslo_concurrency.lockutils [None req-f563c51f-8a25-451b-9860-8dd4e18bcd1e None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  590.964489] env[67954]: DEBUG oslo_concurrency.lockutils [None req-f563c51f-8a25-451b-9860-8dd4e18bcd1e None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  590.964542] env[67954]: DEBUG oslo_concurrency.lockutils [None req-f563c51f-8a25-451b-9860-8dd4e18bcd1e None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  590.980150] env[67954]: DEBUG oslo_concurrency.lockutils [None req-f563c51f-8a25-451b-9860-8dd4e18bcd1e None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  590.980979] env[67954]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f563c51f-8a25-451b-9860-8dd4e18bcd1e None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  590.980979] env[67954]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f563c51f-8a25-451b-9860-8dd4e18bcd1e None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=67954) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  592.986463] env[67954]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f563c51f-8a25-451b-9860-8dd4e18bcd1e None None] Session token - acquiring
[  592.986760] env[67954]: DEBUG networking_nsxv3.common.locking [None req-f563c51f-8a25-451b-9860-8dd4e18bcd1e None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=67954) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  592.986954] env[67954]: DEBUG oslo_concurrency.lockutils [None req-f563c51f-8a25-451b-9860-8dd4e18bcd1e None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  592.987081] env[67954]: DEBUG oslo_concurrency.lockutils [None req-f563c51f-8a25-451b-9860-8dd4e18bcd1e None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  592.987363] env[67954]: DEBUG oslo_concurrency.lockutils [None req-f563c51f-8a25-451b-9860-8dd4e18bcd1e None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  592.997549] env[67954]: DEBUG oslo_concurrency.lockutils [None req-f563c51f-8a25-451b-9860-8dd4e18bcd1e None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  592.997853] env[67954]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f563c51f-8a25-451b-9860-8dd4e18bcd1e None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  592.998051] env[67954]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f563c51f-8a25-451b-9860-8dd4e18bcd1e None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=67954) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  595.001253] env[67954]: CRITICAL neutron [None req-f563c51f-8a25-451b-9860-8dd4e18bcd1e None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  595.001253] env[67954]: ERROR neutron Traceback (most recent call last):
[  595.001253] env[67954]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  595.001253] env[67954]: ERROR neutron     sys.exit(main())
[  595.001253] env[67954]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  595.001253] env[67954]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  595.001253] env[67954]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  595.001253] env[67954]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  595.001253] env[67954]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  595.001253] env[67954]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  595.001253] env[67954]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  595.001253] env[67954]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  595.001253] env[67954]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  595.001253] env[67954]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  595.001253] env[67954]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  595.001253] env[67954]: ERROR neutron     response = self.get(path=path, params=params)
[  595.002106] env[67954]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  595.002106] env[67954]: ERROR neutron     raise RuntimeError(msg, last_err)
[  595.002106] env[67954]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  595.002106] env[67954]: ERROR neutron 
[  597.821804] env[68316]: INFO neutron.common.config [-] Logging enabled!
[  597.822081] env[68316]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  597.822359] env[68316]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=68316) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  597.822617] env[68316]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  597.822715] env[68316]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  597.823572] env[68316]: WARNING oslo_policy.policy [None req-8c5243f6-0ee0-4f2f-9dc1-91660c6c9718 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  597.823794] env[68316]: WARNING oslo_policy.policy [None req-8c5243f6-0ee0-4f2f-9dc1-91660c6c9718 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  597.825057] env[68316]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-8c5243f6-0ee0-4f2f-9dc1-91660c6c9718 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  597.839570] env[68316]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-8c5243f6-0ee0-4f2f-9dc1-91660c6c9718 None None] Session token - acquiring
[  597.840572] env[68316]: DEBUG networking_nsxv3.common.locking [None req-8c5243f6-0ee0-4f2f-9dc1-91660c6c9718 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=68316) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  597.840748] env[68316]: DEBUG oslo_concurrency.lockutils [None req-8c5243f6-0ee0-4f2f-9dc1-91660c6c9718 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68316) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  597.840883] env[68316]: DEBUG oslo_concurrency.lockutils [None req-8c5243f6-0ee0-4f2f-9dc1-91660c6c9718 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68316) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  597.841287] env[68316]: DEBUG oslo_concurrency.lockutils [None req-8c5243f6-0ee0-4f2f-9dc1-91660c6c9718 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68316) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  597.850748] env[68316]: DEBUG oslo_concurrency.lockutils [None req-8c5243f6-0ee0-4f2f-9dc1-91660c6c9718 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68316) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  597.851015] env[68316]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-8c5243f6-0ee0-4f2f-9dc1-91660c6c9718 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  597.851204] env[68316]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-8c5243f6-0ee0-4f2f-9dc1-91660c6c9718 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=68316) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  599.857515] env[68316]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-8c5243f6-0ee0-4f2f-9dc1-91660c6c9718 None None] Session token - acquiring
[  599.857515] env[68316]: DEBUG networking_nsxv3.common.locking [None req-8c5243f6-0ee0-4f2f-9dc1-91660c6c9718 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=68316) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  599.857836] env[68316]: DEBUG oslo_concurrency.lockutils [None req-8c5243f6-0ee0-4f2f-9dc1-91660c6c9718 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68316) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  599.857836] env[68316]: DEBUG oslo_concurrency.lockutils [None req-8c5243f6-0ee0-4f2f-9dc1-91660c6c9718 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68316) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  599.858967] env[68316]: DEBUG oslo_concurrency.lockutils [None req-8c5243f6-0ee0-4f2f-9dc1-91660c6c9718 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68316) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  599.867681] env[68316]: DEBUG oslo_concurrency.lockutils [None req-8c5243f6-0ee0-4f2f-9dc1-91660c6c9718 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68316) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  599.868875] env[68316]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-8c5243f6-0ee0-4f2f-9dc1-91660c6c9718 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  599.868875] env[68316]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-8c5243f6-0ee0-4f2f-9dc1-91660c6c9718 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=68316) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  601.869689] env[68316]: CRITICAL neutron [None req-8c5243f6-0ee0-4f2f-9dc1-91660c6c9718 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  601.869689] env[68316]: ERROR neutron Traceback (most recent call last):
[  601.869689] env[68316]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  601.869689] env[68316]: ERROR neutron     sys.exit(main())
[  601.869689] env[68316]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  601.869689] env[68316]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  601.869689] env[68316]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  601.869689] env[68316]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  601.869689] env[68316]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  601.869689] env[68316]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  601.869689] env[68316]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  601.869689] env[68316]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  601.869689] env[68316]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  601.869689] env[68316]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  601.869689] env[68316]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  601.869689] env[68316]: ERROR neutron     response = self.get(path=path, params=params)
[  601.870368] env[68316]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  601.870368] env[68316]: ERROR neutron     raise RuntimeError(msg, last_err)
[  601.870368] env[68316]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  601.870368] env[68316]: ERROR neutron 
[  604.722518] env[68606]: INFO neutron.common.config [-] Logging enabled!
[  604.722746] env[68606]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  604.723084] env[68606]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=68606) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  604.723310] env[68606]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  604.723402] env[68606]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  604.724353] env[68606]: WARNING oslo_policy.policy [None req-0b71c6ad-0e60-466b-b7d7-5170c6af7092 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  604.724565] env[68606]: WARNING oslo_policy.policy [None req-0b71c6ad-0e60-466b-b7d7-5170c6af7092 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  604.725790] env[68606]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-0b71c6ad-0e60-466b-b7d7-5170c6af7092 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  604.740472] env[68606]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-0b71c6ad-0e60-466b-b7d7-5170c6af7092 None None] Session token - acquiring
[  604.741863] env[68606]: DEBUG networking_nsxv3.common.locking [None req-0b71c6ad-0e60-466b-b7d7-5170c6af7092 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=68606) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  604.742017] env[68606]: DEBUG oslo_concurrency.lockutils [None req-0b71c6ad-0e60-466b-b7d7-5170c6af7092 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68606) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  604.742017] env[68606]: DEBUG oslo_concurrency.lockutils [None req-0b71c6ad-0e60-466b-b7d7-5170c6af7092 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68606) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  604.742387] env[68606]: DEBUG oslo_concurrency.lockutils [None req-0b71c6ad-0e60-466b-b7d7-5170c6af7092 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68606) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  604.753006] env[68606]: DEBUG oslo_concurrency.lockutils [None req-0b71c6ad-0e60-466b-b7d7-5170c6af7092 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68606) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  604.753260] env[68606]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-0b71c6ad-0e60-466b-b7d7-5170c6af7092 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  604.753401] env[68606]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-0b71c6ad-0e60-466b-b7d7-5170c6af7092 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=68606) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  606.760203] env[68606]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-0b71c6ad-0e60-466b-b7d7-5170c6af7092 None None] Session token - acquiring
[  606.760523] env[68606]: DEBUG networking_nsxv3.common.locking [None req-0b71c6ad-0e60-466b-b7d7-5170c6af7092 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=68606) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  606.760794] env[68606]: DEBUG oslo_concurrency.lockutils [None req-0b71c6ad-0e60-466b-b7d7-5170c6af7092 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68606) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  606.760794] env[68606]: DEBUG oslo_concurrency.lockutils [None req-0b71c6ad-0e60-466b-b7d7-5170c6af7092 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68606) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  606.765302] env[68606]: DEBUG oslo_concurrency.lockutils [None req-0b71c6ad-0e60-466b-b7d7-5170c6af7092 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68606) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  606.777029] env[68606]: DEBUG oslo_concurrency.lockutils [None req-0b71c6ad-0e60-466b-b7d7-5170c6af7092 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68606) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  606.777289] env[68606]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-0b71c6ad-0e60-466b-b7d7-5170c6af7092 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  606.777428] env[68606]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-0b71c6ad-0e60-466b-b7d7-5170c6af7092 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=68606) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  608.780382] env[68606]: CRITICAL neutron [None req-0b71c6ad-0e60-466b-b7d7-5170c6af7092 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  608.780382] env[68606]: ERROR neutron Traceback (most recent call last):
[  608.780382] env[68606]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  608.780382] env[68606]: ERROR neutron     sys.exit(main())
[  608.780382] env[68606]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  608.780382] env[68606]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  608.780382] env[68606]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  608.780382] env[68606]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  608.780382] env[68606]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  608.780382] env[68606]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  608.780382] env[68606]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  608.780382] env[68606]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  608.780382] env[68606]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  608.780382] env[68606]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  608.780382] env[68606]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  608.780382] env[68606]: ERROR neutron     response = self.get(path=path, params=params)
[  608.781087] env[68606]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  608.781087] env[68606]: ERROR neutron     raise RuntimeError(msg, last_err)
[  608.781087] env[68606]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  608.781087] env[68606]: ERROR neutron 
[  611.599483] env[68747]: INFO neutron.common.config [-] Logging enabled!
[  611.599719] env[68747]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  611.600035] env[68747]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=68747) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  611.600262] env[68747]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  611.600352] env[68747]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  611.601219] env[68747]: WARNING oslo_policy.policy [None req-df61666a-439a-4e49-a4af-a071512ed16a None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  611.601453] env[68747]: WARNING oslo_policy.policy [None req-df61666a-439a-4e49-a4af-a071512ed16a None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  611.602734] env[68747]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-df61666a-439a-4e49-a4af-a071512ed16a None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  611.618644] env[68747]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-df61666a-439a-4e49-a4af-a071512ed16a None None] Session token - acquiring
[  611.619993] env[68747]: DEBUG networking_nsxv3.common.locking [None req-df61666a-439a-4e49-a4af-a071512ed16a None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=68747) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  611.620222] env[68747]: DEBUG oslo_concurrency.lockutils [None req-df61666a-439a-4e49-a4af-a071512ed16a None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68747) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  611.620347] env[68747]: DEBUG oslo_concurrency.lockutils [None req-df61666a-439a-4e49-a4af-a071512ed16a None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68747) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  611.620748] env[68747]: DEBUG oslo_concurrency.lockutils [None req-df61666a-439a-4e49-a4af-a071512ed16a None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68747) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  611.639385] env[68747]: DEBUG oslo_concurrency.lockutils [None req-df61666a-439a-4e49-a4af-a071512ed16a None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68747) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  611.639684] env[68747]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-df61666a-439a-4e49-a4af-a071512ed16a None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  611.639881] env[68747]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-df61666a-439a-4e49-a4af-a071512ed16a None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=68747) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  613.645834] env[68747]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-df61666a-439a-4e49-a4af-a071512ed16a None None] Session token - acquiring
[  613.646262] env[68747]: DEBUG networking_nsxv3.common.locking [None req-df61666a-439a-4e49-a4af-a071512ed16a None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=68747) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  613.646460] env[68747]: DEBUG oslo_concurrency.lockutils [None req-df61666a-439a-4e49-a4af-a071512ed16a None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68747) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  613.646584] env[68747]: DEBUG oslo_concurrency.lockutils [None req-df61666a-439a-4e49-a4af-a071512ed16a None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68747) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  613.646852] env[68747]: DEBUG oslo_concurrency.lockutils [None req-df61666a-439a-4e49-a4af-a071512ed16a None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68747) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  613.656156] env[68747]: DEBUG oslo_concurrency.lockutils [None req-df61666a-439a-4e49-a4af-a071512ed16a None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68747) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  613.656521] env[68747]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-df61666a-439a-4e49-a4af-a071512ed16a None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  613.656763] env[68747]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-df61666a-439a-4e49-a4af-a071512ed16a None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=68747) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  615.659731] env[68747]: CRITICAL neutron [None req-df61666a-439a-4e49-a4af-a071512ed16a None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  615.659731] env[68747]: ERROR neutron Traceback (most recent call last):
[  615.659731] env[68747]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  615.659731] env[68747]: ERROR neutron     sys.exit(main())
[  615.659731] env[68747]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  615.659731] env[68747]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  615.659731] env[68747]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  615.659731] env[68747]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  615.659731] env[68747]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  615.659731] env[68747]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  615.659731] env[68747]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  615.659731] env[68747]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  615.659731] env[68747]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  615.659731] env[68747]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  615.659731] env[68747]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  615.659731] env[68747]: ERROR neutron     response = self.get(path=path, params=params)
[  615.660351] env[68747]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  615.660351] env[68747]: ERROR neutron     raise RuntimeError(msg, last_err)
[  615.660351] env[68747]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  615.660351] env[68747]: ERROR neutron 
[  618.501191] env[69100]: INFO neutron.common.config [-] Logging enabled!
[  618.501563] env[69100]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  618.501709] env[69100]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=69100) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  618.502013] env[69100]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  618.502058] env[69100]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  618.502877] env[69100]: WARNING oslo_policy.policy [None req-e49b1338-5c23-4787-a57c-346c001c0695 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  618.503086] env[69100]: WARNING oslo_policy.policy [None req-e49b1338-5c23-4787-a57c-346c001c0695 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  618.504286] env[69100]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-e49b1338-5c23-4787-a57c-346c001c0695 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  618.518389] env[69100]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e49b1338-5c23-4787-a57c-346c001c0695 None None] Session token - acquiring
[  618.519221] env[69100]: DEBUG networking_nsxv3.common.locking [None req-e49b1338-5c23-4787-a57c-346c001c0695 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=69100) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  618.519420] env[69100]: DEBUG oslo_concurrency.lockutils [None req-e49b1338-5c23-4787-a57c-346c001c0695 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  618.519548] env[69100]: DEBUG oslo_concurrency.lockutils [None req-e49b1338-5c23-4787-a57c-346c001c0695 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  618.519912] env[69100]: DEBUG oslo_concurrency.lockutils [None req-e49b1338-5c23-4787-a57c-346c001c0695 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  618.529274] env[69100]: DEBUG oslo_concurrency.lockutils [None req-e49b1338-5c23-4787-a57c-346c001c0695 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  618.529524] env[69100]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e49b1338-5c23-4787-a57c-346c001c0695 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  618.529667] env[69100]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e49b1338-5c23-4787-a57c-346c001c0695 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=69100) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  620.535624] env[69100]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e49b1338-5c23-4787-a57c-346c001c0695 None None] Session token - acquiring
[  620.535944] env[69100]: DEBUG networking_nsxv3.common.locking [None req-e49b1338-5c23-4787-a57c-346c001c0695 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=69100) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  620.540021] env[69100]: DEBUG oslo_concurrency.lockutils [None req-e49b1338-5c23-4787-a57c-346c001c0695 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  620.540021] env[69100]: DEBUG oslo_concurrency.lockutils [None req-e49b1338-5c23-4787-a57c-346c001c0695 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  620.540021] env[69100]: DEBUG oslo_concurrency.lockutils [None req-e49b1338-5c23-4787-a57c-346c001c0695 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  620.546263] env[69100]: DEBUG oslo_concurrency.lockutils [None req-e49b1338-5c23-4787-a57c-346c001c0695 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  620.546622] env[69100]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e49b1338-5c23-4787-a57c-346c001c0695 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  620.546940] env[69100]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e49b1338-5c23-4787-a57c-346c001c0695 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=69100) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  622.548898] env[69100]: CRITICAL neutron [None req-e49b1338-5c23-4787-a57c-346c001c0695 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  622.548898] env[69100]: ERROR neutron Traceback (most recent call last):
[  622.548898] env[69100]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  622.548898] env[69100]: ERROR neutron     sys.exit(main())
[  622.548898] env[69100]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  622.548898] env[69100]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  622.548898] env[69100]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  622.548898] env[69100]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  622.548898] env[69100]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  622.548898] env[69100]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  622.548898] env[69100]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  622.548898] env[69100]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  622.548898] env[69100]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  622.548898] env[69100]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  622.548898] env[69100]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  622.548898] env[69100]: ERROR neutron     response = self.get(path=path, params=params)
[  622.549596] env[69100]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  622.549596] env[69100]: ERROR neutron     raise RuntimeError(msg, last_err)
[  622.549596] env[69100]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  622.549596] env[69100]: ERROR neutron 
[  625.281544] env[69129]: INFO neutron.common.config [-] Logging enabled!
[  625.281817] env[69129]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  625.282091] env[69129]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=69129) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  625.282327] env[69129]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  625.282505] env[69129]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  625.283321] env[69129]: WARNING oslo_policy.policy [None req-0940270d-9e76-471c-a1fb-4033c21229b2 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  625.283569] env[69129]: WARNING oslo_policy.policy [None req-0940270d-9e76-471c-a1fb-4033c21229b2 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  625.284865] env[69129]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-0940270d-9e76-471c-a1fb-4033c21229b2 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  625.301146] env[69129]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-0940270d-9e76-471c-a1fb-4033c21229b2 None None] Session token - acquiring
[  625.301146] env[69129]: DEBUG networking_nsxv3.common.locking [None req-0940270d-9e76-471c-a1fb-4033c21229b2 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=69129) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  625.301146] env[69129]: DEBUG oslo_concurrency.lockutils [None req-0940270d-9e76-471c-a1fb-4033c21229b2 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69129) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  625.301414] env[69129]: DEBUG oslo_concurrency.lockutils [None req-0940270d-9e76-471c-a1fb-4033c21229b2 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69129) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  625.301414] env[69129]: DEBUG oslo_concurrency.lockutils [None req-0940270d-9e76-471c-a1fb-4033c21229b2 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69129) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  625.310650] env[69129]: DEBUG oslo_concurrency.lockutils [None req-0940270d-9e76-471c-a1fb-4033c21229b2 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69129) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  625.310916] env[69129]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-0940270d-9e76-471c-a1fb-4033c21229b2 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  625.311060] env[69129]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-0940270d-9e76-471c-a1fb-4033c21229b2 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=69129) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  627.318213] env[69129]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-0940270d-9e76-471c-a1fb-4033c21229b2 None None] Session token - acquiring
[  627.318543] env[69129]: DEBUG networking_nsxv3.common.locking [None req-0940270d-9e76-471c-a1fb-4033c21229b2 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=69129) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  627.318714] env[69129]: DEBUG oslo_concurrency.lockutils [None req-0940270d-9e76-471c-a1fb-4033c21229b2 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69129) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  627.318844] env[69129]: DEBUG oslo_concurrency.lockutils [None req-0940270d-9e76-471c-a1fb-4033c21229b2 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69129) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  627.319205] env[69129]: DEBUG oslo_concurrency.lockutils [None req-0940270d-9e76-471c-a1fb-4033c21229b2 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69129) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  627.329611] env[69129]: DEBUG oslo_concurrency.lockutils [None req-0940270d-9e76-471c-a1fb-4033c21229b2 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69129) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  627.329611] env[69129]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-0940270d-9e76-471c-a1fb-4033c21229b2 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  627.329611] env[69129]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-0940270d-9e76-471c-a1fb-4033c21229b2 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=69129) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  629.338867] env[69129]: CRITICAL neutron [None req-0940270d-9e76-471c-a1fb-4033c21229b2 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  629.338867] env[69129]: ERROR neutron Traceback (most recent call last):
[  629.338867] env[69129]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  629.338867] env[69129]: ERROR neutron     sys.exit(main())
[  629.338867] env[69129]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  629.338867] env[69129]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  629.338867] env[69129]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  629.338867] env[69129]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  629.338867] env[69129]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  629.338867] env[69129]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  629.338867] env[69129]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  629.338867] env[69129]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  629.338867] env[69129]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  629.338867] env[69129]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  629.338867] env[69129]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  629.338867] env[69129]: ERROR neutron     response = self.get(path=path, params=params)
[  629.339594] env[69129]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  629.339594] env[69129]: ERROR neutron     raise RuntimeError(msg, last_err)
[  629.339594] env[69129]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  629.339594] env[69129]: ERROR neutron 
[  632.045743] env[69310]: INFO neutron.common.config [-] Logging enabled!
[  632.046059] env[69310]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  632.046642] env[69310]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=69310) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  632.046642] env[69310]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  632.046642] env[69310]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  632.047454] env[69310]: WARNING oslo_policy.policy [None req-603f61da-84a0-4f81-826c-1aee2a9f11a7 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  632.047682] env[69310]: WARNING oslo_policy.policy [None req-603f61da-84a0-4f81-826c-1aee2a9f11a7 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  632.049034] env[69310]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-603f61da-84a0-4f81-826c-1aee2a9f11a7 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  632.063864] env[69310]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-603f61da-84a0-4f81-826c-1aee2a9f11a7 None None] Session token - acquiring
[  632.064722] env[69310]: DEBUG networking_nsxv3.common.locking [None req-603f61da-84a0-4f81-826c-1aee2a9f11a7 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=69310) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  632.064921] env[69310]: DEBUG oslo_concurrency.lockutils [None req-603f61da-84a0-4f81-826c-1aee2a9f11a7 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69310) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  632.065045] env[69310]: DEBUG oslo_concurrency.lockutils [None req-603f61da-84a0-4f81-826c-1aee2a9f11a7 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69310) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  632.065425] env[69310]: DEBUG oslo_concurrency.lockutils [None req-603f61da-84a0-4f81-826c-1aee2a9f11a7 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69310) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  632.074516] env[69310]: DEBUG oslo_concurrency.lockutils [None req-603f61da-84a0-4f81-826c-1aee2a9f11a7 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69310) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  632.074779] env[69310]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-603f61da-84a0-4f81-826c-1aee2a9f11a7 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  632.074995] env[69310]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-603f61da-84a0-4f81-826c-1aee2a9f11a7 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=69310) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  634.081453] env[69310]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-603f61da-84a0-4f81-826c-1aee2a9f11a7 None None] Session token - acquiring
[  634.081833] env[69310]: DEBUG networking_nsxv3.common.locking [None req-603f61da-84a0-4f81-826c-1aee2a9f11a7 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=69310) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  634.082050] env[69310]: DEBUG oslo_concurrency.lockutils [None req-603f61da-84a0-4f81-826c-1aee2a9f11a7 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69310) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  634.082268] env[69310]: DEBUG oslo_concurrency.lockutils [None req-603f61da-84a0-4f81-826c-1aee2a9f11a7 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69310) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  634.082492] env[69310]: DEBUG oslo_concurrency.lockutils [None req-603f61da-84a0-4f81-826c-1aee2a9f11a7 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69310) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  634.093075] env[69310]: DEBUG oslo_concurrency.lockutils [None req-603f61da-84a0-4f81-826c-1aee2a9f11a7 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69310) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  634.093349] env[69310]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-603f61da-84a0-4f81-826c-1aee2a9f11a7 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  634.093507] env[69310]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-603f61da-84a0-4f81-826c-1aee2a9f11a7 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=69310) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  636.096431] env[69310]: CRITICAL neutron [None req-603f61da-84a0-4f81-826c-1aee2a9f11a7 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  636.096431] env[69310]: ERROR neutron Traceback (most recent call last):
[  636.096431] env[69310]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  636.096431] env[69310]: ERROR neutron     sys.exit(main())
[  636.096431] env[69310]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  636.096431] env[69310]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  636.096431] env[69310]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  636.096431] env[69310]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  636.096431] env[69310]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  636.096431] env[69310]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  636.096431] env[69310]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  636.096431] env[69310]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  636.096431] env[69310]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  636.096431] env[69310]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  636.096431] env[69310]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  636.096431] env[69310]: ERROR neutron     response = self.get(path=path, params=params)
[  636.097814] env[69310]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  636.097814] env[69310]: ERROR neutron     raise RuntimeError(msg, last_err)
[  636.097814] env[69310]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  636.097814] env[69310]: ERROR neutron 
[  638.744745] env[69377]: INFO neutron.common.config [-] Logging enabled!
[  638.745089] env[69377]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  638.745308] env[69377]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=69377) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  638.745511] env[69377]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  638.745606] env[69377]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  638.746462] env[69377]: WARNING oslo_policy.policy [None req-aacf91e6-ac97-4890-a2ea-8a710969cbc6 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  638.746682] env[69377]: WARNING oslo_policy.policy [None req-aacf91e6-ac97-4890-a2ea-8a710969cbc6 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  638.747931] env[69377]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-aacf91e6-ac97-4890-a2ea-8a710969cbc6 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  638.767807] env[69377]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-aacf91e6-ac97-4890-a2ea-8a710969cbc6 None None] Session token - acquiring
[  638.768713] env[69377]: DEBUG networking_nsxv3.common.locking [None req-aacf91e6-ac97-4890-a2ea-8a710969cbc6 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=69377) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  638.768983] env[69377]: DEBUG oslo_concurrency.lockutils [None req-aacf91e6-ac97-4890-a2ea-8a710969cbc6 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69377) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  638.769056] env[69377]: DEBUG oslo_concurrency.lockutils [None req-aacf91e6-ac97-4890-a2ea-8a710969cbc6 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69377) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  638.769412] env[69377]: DEBUG oslo_concurrency.lockutils [None req-aacf91e6-ac97-4890-a2ea-8a710969cbc6 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69377) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  638.779146] env[69377]: DEBUG oslo_concurrency.lockutils [None req-aacf91e6-ac97-4890-a2ea-8a710969cbc6 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69377) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  638.779416] env[69377]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-aacf91e6-ac97-4890-a2ea-8a710969cbc6 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  638.779567] env[69377]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-aacf91e6-ac97-4890-a2ea-8a710969cbc6 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=69377) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  640.785558] env[69377]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-aacf91e6-ac97-4890-a2ea-8a710969cbc6 None None] Session token - acquiring
[  640.785948] env[69377]: DEBUG networking_nsxv3.common.locking [None req-aacf91e6-ac97-4890-a2ea-8a710969cbc6 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=69377) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  640.786153] env[69377]: DEBUG oslo_concurrency.lockutils [None req-aacf91e6-ac97-4890-a2ea-8a710969cbc6 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69377) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  640.786281] env[69377]: DEBUG oslo_concurrency.lockutils [None req-aacf91e6-ac97-4890-a2ea-8a710969cbc6 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69377) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  640.786551] env[69377]: DEBUG oslo_concurrency.lockutils [None req-aacf91e6-ac97-4890-a2ea-8a710969cbc6 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69377) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  640.795840] env[69377]: DEBUG oslo_concurrency.lockutils [None req-aacf91e6-ac97-4890-a2ea-8a710969cbc6 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69377) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  640.796159] env[69377]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-aacf91e6-ac97-4890-a2ea-8a710969cbc6 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  640.796320] env[69377]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-aacf91e6-ac97-4890-a2ea-8a710969cbc6 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=69377) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  642.799200] env[69377]: CRITICAL neutron [None req-aacf91e6-ac97-4890-a2ea-8a710969cbc6 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  642.799200] env[69377]: ERROR neutron Traceback (most recent call last):
[  642.799200] env[69377]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  642.799200] env[69377]: ERROR neutron     sys.exit(main())
[  642.799200] env[69377]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  642.799200] env[69377]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  642.799200] env[69377]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  642.799200] env[69377]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  642.799200] env[69377]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  642.799200] env[69377]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  642.799200] env[69377]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  642.799200] env[69377]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  642.799200] env[69377]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  642.799200] env[69377]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  642.799200] env[69377]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  642.799200] env[69377]: ERROR neutron     response = self.get(path=path, params=params)
[  642.800134] env[69377]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  642.800134] env[69377]: ERROR neutron     raise RuntimeError(msg, last_err)
[  642.800134] env[69377]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  642.800134] env[69377]: ERROR neutron 
[  645.463254] env[69491]: INFO neutron.common.config [-] Logging enabled!
[  645.463507] env[69491]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  645.463892] env[69491]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=69491) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  645.464168] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  645.464532] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  645.465111] env[69491]: WARNING oslo_policy.policy [None req-4d61a0e2-0da3-436d-8fe5-a655704542dd None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  645.465332] env[69491]: WARNING oslo_policy.policy [None req-4d61a0e2-0da3-436d-8fe5-a655704542dd None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  645.466546] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-4d61a0e2-0da3-436d-8fe5-a655704542dd None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  645.481479] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-4d61a0e2-0da3-436d-8fe5-a655704542dd None None] Session token - acquiring
[  645.482359] env[69491]: DEBUG networking_nsxv3.common.locking [None req-4d61a0e2-0da3-436d-8fe5-a655704542dd None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  645.482621] env[69491]: DEBUG oslo_concurrency.lockutils [None req-4d61a0e2-0da3-436d-8fe5-a655704542dd None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  645.484715] env[69491]: DEBUG oslo_concurrency.lockutils [None req-4d61a0e2-0da3-436d-8fe5-a655704542dd None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  645.484715] env[69491]: DEBUG oslo_concurrency.lockutils [None req-4d61a0e2-0da3-436d-8fe5-a655704542dd None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  645.500284] env[69491]: DEBUG oslo_concurrency.lockutils [None req-4d61a0e2-0da3-436d-8fe5-a655704542dd None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  645.500714] env[69491]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-4d61a0e2-0da3-436d-8fe5-a655704542dd None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  645.501001] env[69491]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-4d61a0e2-0da3-436d-8fe5-a655704542dd None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=69491) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  647.507406] env[69491]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-4d61a0e2-0da3-436d-8fe5-a655704542dd None None] Session token - acquiring
[  647.507708] env[69491]: DEBUG networking_nsxv3.common.locking [None req-4d61a0e2-0da3-436d-8fe5-a655704542dd None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=69491) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  647.507708] env[69491]: DEBUG oslo_concurrency.lockutils [None req-4d61a0e2-0da3-436d-8fe5-a655704542dd None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  647.507843] env[69491]: DEBUG oslo_concurrency.lockutils [None req-4d61a0e2-0da3-436d-8fe5-a655704542dd None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  647.508112] env[69491]: DEBUG oslo_concurrency.lockutils [None req-4d61a0e2-0da3-436d-8fe5-a655704542dd None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  647.517597] env[69491]: DEBUG oslo_concurrency.lockutils [None req-4d61a0e2-0da3-436d-8fe5-a655704542dd None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  647.518073] env[69491]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-4d61a0e2-0da3-436d-8fe5-a655704542dd None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  647.518073] env[69491]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-4d61a0e2-0da3-436d-8fe5-a655704542dd None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=69491) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  649.521024] env[69491]: CRITICAL neutron [None req-4d61a0e2-0da3-436d-8fe5-a655704542dd None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  649.521024] env[69491]: ERROR neutron Traceback (most recent call last):
[  649.521024] env[69491]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  649.521024] env[69491]: ERROR neutron     sys.exit(main())
[  649.521024] env[69491]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  649.521024] env[69491]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  649.521024] env[69491]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  649.521024] env[69491]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  649.521024] env[69491]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  649.521024] env[69491]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  649.521024] env[69491]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  649.521024] env[69491]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  649.521024] env[69491]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  649.521024] env[69491]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  649.521024] env[69491]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  649.521024] env[69491]: ERROR neutron     response = self.get(path=path, params=params)
[  649.521828] env[69491]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  649.521828] env[69491]: ERROR neutron     raise RuntimeError(msg, last_err)
[  649.521828] env[69491]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  649.521828] env[69491]: ERROR neutron 
[  652.139531] env[69580]: INFO neutron.common.config [-] Logging enabled!
[  652.139869] env[69580]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  652.140095] env[69580]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=69580) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  652.140319] env[69580]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  652.140407] env[69580]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  652.141263] env[69580]: WARNING oslo_policy.policy [None req-7639f198-a341-4e44-b489-88fa8a8a03bd None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  652.141474] env[69580]: WARNING oslo_policy.policy [None req-7639f198-a341-4e44-b489-88fa8a8a03bd None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  652.142789] env[69580]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-7639f198-a341-4e44-b489-88fa8a8a03bd None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  652.160693] env[69580]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-7639f198-a341-4e44-b489-88fa8a8a03bd None None] Session token - acquiring
[  652.161553] env[69580]: DEBUG networking_nsxv3.common.locking [None req-7639f198-a341-4e44-b489-88fa8a8a03bd None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=69580) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  652.161746] env[69580]: DEBUG oslo_concurrency.lockutils [None req-7639f198-a341-4e44-b489-88fa8a8a03bd None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69580) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  652.161871] env[69580]: DEBUG oslo_concurrency.lockutils [None req-7639f198-a341-4e44-b489-88fa8a8a03bd None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69580) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  652.162371] env[69580]: DEBUG oslo_concurrency.lockutils [None req-7639f198-a341-4e44-b489-88fa8a8a03bd None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69580) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  652.172424] env[69580]: DEBUG oslo_concurrency.lockutils [None req-7639f198-a341-4e44-b489-88fa8a8a03bd None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69580) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  652.172678] env[69580]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-7639f198-a341-4e44-b489-88fa8a8a03bd None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  652.172826] env[69580]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-7639f198-a341-4e44-b489-88fa8a8a03bd None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=69580) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  654.178728] env[69580]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-7639f198-a341-4e44-b489-88fa8a8a03bd None None] Session token - acquiring
[  654.179011] env[69580]: DEBUG networking_nsxv3.common.locking [None req-7639f198-a341-4e44-b489-88fa8a8a03bd None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=69580) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  654.179194] env[69580]: DEBUG oslo_concurrency.lockutils [None req-7639f198-a341-4e44-b489-88fa8a8a03bd None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69580) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  654.179315] env[69580]: DEBUG oslo_concurrency.lockutils [None req-7639f198-a341-4e44-b489-88fa8a8a03bd None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69580) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  654.179578] env[69580]: DEBUG oslo_concurrency.lockutils [None req-7639f198-a341-4e44-b489-88fa8a8a03bd None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69580) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  654.188730] env[69580]: DEBUG oslo_concurrency.lockutils [None req-7639f198-a341-4e44-b489-88fa8a8a03bd None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69580) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  654.188887] env[69580]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-7639f198-a341-4e44-b489-88fa8a8a03bd None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  654.189023] env[69580]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-7639f198-a341-4e44-b489-88fa8a8a03bd None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=69580) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  656.191901] env[69580]: CRITICAL neutron [None req-7639f198-a341-4e44-b489-88fa8a8a03bd None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  656.191901] env[69580]: ERROR neutron Traceback (most recent call last):
[  656.191901] env[69580]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  656.191901] env[69580]: ERROR neutron     sys.exit(main())
[  656.191901] env[69580]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  656.191901] env[69580]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  656.191901] env[69580]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  656.191901] env[69580]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  656.191901] env[69580]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  656.191901] env[69580]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  656.191901] env[69580]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  656.191901] env[69580]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  656.191901] env[69580]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  656.191901] env[69580]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  656.191901] env[69580]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  656.191901] env[69580]: ERROR neutron     response = self.get(path=path, params=params)
[  656.192624] env[69580]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  656.192624] env[69580]: ERROR neutron     raise RuntimeError(msg, last_err)
[  656.192624] env[69580]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  656.192624] env[69580]: ERROR neutron 
[  658.677780] env[69653]: INFO neutron.common.config [-] Logging enabled!
[  658.677780] env[69653]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  658.678178] env[69653]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=69653) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  658.678406] env[69653]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  658.678491] env[69653]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  658.679355] env[69653]: WARNING oslo_policy.policy [None req-a15827cd-ab2e-48e8-bdb5-f4b61cbe6c97 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  658.679582] env[69653]: WARNING oslo_policy.policy [None req-a15827cd-ab2e-48e8-bdb5-f4b61cbe6c97 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  658.680871] env[69653]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-a15827cd-ab2e-48e8-bdb5-f4b61cbe6c97 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  658.695228] env[69653]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-a15827cd-ab2e-48e8-bdb5-f4b61cbe6c97 None None] Session token - acquiring
[  658.696076] env[69653]: DEBUG networking_nsxv3.common.locking [None req-a15827cd-ab2e-48e8-bdb5-f4b61cbe6c97 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=69653) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  658.696276] env[69653]: DEBUG oslo_concurrency.lockutils [None req-a15827cd-ab2e-48e8-bdb5-f4b61cbe6c97 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69653) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  658.696398] env[69653]: DEBUG oslo_concurrency.lockutils [None req-a15827cd-ab2e-48e8-bdb5-f4b61cbe6c97 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69653) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  658.696765] env[69653]: DEBUG oslo_concurrency.lockutils [None req-a15827cd-ab2e-48e8-bdb5-f4b61cbe6c97 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69653) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  658.712367] env[69653]: DEBUG oslo_concurrency.lockutils [None req-a15827cd-ab2e-48e8-bdb5-f4b61cbe6c97 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69653) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  658.712637] env[69653]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-a15827cd-ab2e-48e8-bdb5-f4b61cbe6c97 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  658.712801] env[69653]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-a15827cd-ab2e-48e8-bdb5-f4b61cbe6c97 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=69653) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  660.720989] env[69653]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-a15827cd-ab2e-48e8-bdb5-f4b61cbe6c97 None None] Session token - acquiring
[  660.721345] env[69653]: DEBUG networking_nsxv3.common.locking [None req-a15827cd-ab2e-48e8-bdb5-f4b61cbe6c97 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=69653) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  660.721439] env[69653]: DEBUG oslo_concurrency.lockutils [None req-a15827cd-ab2e-48e8-bdb5-f4b61cbe6c97 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69653) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  660.721619] env[69653]: DEBUG oslo_concurrency.lockutils [None req-a15827cd-ab2e-48e8-bdb5-f4b61cbe6c97 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69653) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  660.721897] env[69653]: DEBUG oslo_concurrency.lockutils [None req-a15827cd-ab2e-48e8-bdb5-f4b61cbe6c97 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69653) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  660.731393] env[69653]: DEBUG oslo_concurrency.lockutils [None req-a15827cd-ab2e-48e8-bdb5-f4b61cbe6c97 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69653) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  660.731649] env[69653]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-a15827cd-ab2e-48e8-bdb5-f4b61cbe6c97 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  660.731786] env[69653]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-a15827cd-ab2e-48e8-bdb5-f4b61cbe6c97 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=69653) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  662.732909] env[69653]: CRITICAL neutron [None req-a15827cd-ab2e-48e8-bdb5-f4b61cbe6c97 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  662.732909] env[69653]: ERROR neutron Traceback (most recent call last):
[  662.732909] env[69653]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  662.732909] env[69653]: ERROR neutron     sys.exit(main())
[  662.732909] env[69653]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  662.732909] env[69653]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  662.732909] env[69653]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  662.732909] env[69653]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  662.732909] env[69653]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  662.732909] env[69653]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  662.732909] env[69653]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  662.732909] env[69653]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  662.732909] env[69653]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  662.732909] env[69653]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  662.732909] env[69653]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  662.732909] env[69653]: ERROR neutron     response = self.get(path=path, params=params)
[  662.733711] env[69653]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  662.733711] env[69653]: ERROR neutron     raise RuntimeError(msg, last_err)
[  662.733711] env[69653]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  662.733711] env[69653]: ERROR neutron 
[  665.546133] env[69741]: INFO neutron.common.config [-] Logging enabled!
[  665.546478] env[69741]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  665.546696] env[69741]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=69741) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  665.546890] env[69741]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  665.546987] env[69741]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  665.547850] env[69741]: WARNING oslo_policy.policy [None req-767c3dda-0c2c-42f2-b0cb-75f6f4291b08 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  665.548103] env[69741]: WARNING oslo_policy.policy [None req-767c3dda-0c2c-42f2-b0cb-75f6f4291b08 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  665.549311] env[69741]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-767c3dda-0c2c-42f2-b0cb-75f6f4291b08 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  665.565166] env[69741]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-767c3dda-0c2c-42f2-b0cb-75f6f4291b08 None None] Session token - acquiring
[  665.566057] env[69741]: DEBUG networking_nsxv3.common.locking [None req-767c3dda-0c2c-42f2-b0cb-75f6f4291b08 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=69741) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  665.566268] env[69741]: DEBUG oslo_concurrency.lockutils [None req-767c3dda-0c2c-42f2-b0cb-75f6f4291b08 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69741) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  665.566399] env[69741]: DEBUG oslo_concurrency.lockutils [None req-767c3dda-0c2c-42f2-b0cb-75f6f4291b08 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69741) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  665.566782] env[69741]: DEBUG oslo_concurrency.lockutils [None req-767c3dda-0c2c-42f2-b0cb-75f6f4291b08 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69741) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  665.577799] env[69741]: DEBUG oslo_concurrency.lockutils [None req-767c3dda-0c2c-42f2-b0cb-75f6f4291b08 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69741) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  665.577799] env[69741]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-767c3dda-0c2c-42f2-b0cb-75f6f4291b08 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  665.577799] env[69741]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-767c3dda-0c2c-42f2-b0cb-75f6f4291b08 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=69741) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  667.584350] env[69741]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-767c3dda-0c2c-42f2-b0cb-75f6f4291b08 None None] Session token - acquiring
[  667.584789] env[69741]: DEBUG networking_nsxv3.common.locking [None req-767c3dda-0c2c-42f2-b0cb-75f6f4291b08 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=69741) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  667.585159] env[69741]: DEBUG oslo_concurrency.lockutils [None req-767c3dda-0c2c-42f2-b0cb-75f6f4291b08 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69741) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  667.585159] env[69741]: DEBUG oslo_concurrency.lockutils [None req-767c3dda-0c2c-42f2-b0cb-75f6f4291b08 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69741) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  667.585389] env[69741]: DEBUG oslo_concurrency.lockutils [None req-767c3dda-0c2c-42f2-b0cb-75f6f4291b08 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69741) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  667.594819] env[69741]: DEBUG oslo_concurrency.lockutils [None req-767c3dda-0c2c-42f2-b0cb-75f6f4291b08 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69741) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  667.595089] env[69741]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-767c3dda-0c2c-42f2-b0cb-75f6f4291b08 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  667.595283] env[69741]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-767c3dda-0c2c-42f2-b0cb-75f6f4291b08 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=69741) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  669.604533] env[69741]: CRITICAL neutron [None req-767c3dda-0c2c-42f2-b0cb-75f6f4291b08 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  669.604533] env[69741]: ERROR neutron Traceback (most recent call last):
[  669.604533] env[69741]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  669.604533] env[69741]: ERROR neutron     sys.exit(main())
[  669.604533] env[69741]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  669.604533] env[69741]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  669.604533] env[69741]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  669.604533] env[69741]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  669.604533] env[69741]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  669.604533] env[69741]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  669.604533] env[69741]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  669.604533] env[69741]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  669.604533] env[69741]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  669.604533] env[69741]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  669.604533] env[69741]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  669.604533] env[69741]: ERROR neutron     response = self.get(path=path, params=params)
[  669.605373] env[69741]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  669.605373] env[69741]: ERROR neutron     raise RuntimeError(msg, last_err)
[  669.605373] env[69741]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  669.605373] env[69741]: ERROR neutron 
[  672.267910] env[69961]: INFO neutron.common.config [-] Logging enabled!
[  672.268249] env[69961]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  672.268541] env[69961]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=69961) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  672.268817] env[69961]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  672.268920] env[69961]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  672.269799] env[69961]: WARNING oslo_policy.policy [None req-96ff1db2-64c7-4b5c-9a9f-bee0ad8fb44c None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  672.270398] env[69961]: WARNING oslo_policy.policy [None req-96ff1db2-64c7-4b5c-9a9f-bee0ad8fb44c None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  672.271276] env[69961]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-96ff1db2-64c7-4b5c-9a9f-bee0ad8fb44c None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  672.286128] env[69961]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-96ff1db2-64c7-4b5c-9a9f-bee0ad8fb44c None None] Session token - acquiring
[  672.286996] env[69961]: DEBUG networking_nsxv3.common.locking [None req-96ff1db2-64c7-4b5c-9a9f-bee0ad8fb44c None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=69961) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  672.287211] env[69961]: DEBUG oslo_concurrency.lockutils [None req-96ff1db2-64c7-4b5c-9a9f-bee0ad8fb44c None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69961) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  672.287338] env[69961]: DEBUG oslo_concurrency.lockutils [None req-96ff1db2-64c7-4b5c-9a9f-bee0ad8fb44c None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69961) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  672.287711] env[69961]: DEBUG oslo_concurrency.lockutils [None req-96ff1db2-64c7-4b5c-9a9f-bee0ad8fb44c None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69961) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  672.296859] env[69961]: DEBUG oslo_concurrency.lockutils [None req-96ff1db2-64c7-4b5c-9a9f-bee0ad8fb44c None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69961) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  672.297110] env[69961]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-96ff1db2-64c7-4b5c-9a9f-bee0ad8fb44c None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  672.297257] env[69961]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-96ff1db2-64c7-4b5c-9a9f-bee0ad8fb44c None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=69961) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  674.303836] env[69961]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-96ff1db2-64c7-4b5c-9a9f-bee0ad8fb44c None None] Session token - acquiring
[  674.304183] env[69961]: DEBUG networking_nsxv3.common.locking [None req-96ff1db2-64c7-4b5c-9a9f-bee0ad8fb44c None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=69961) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  674.304461] env[69961]: DEBUG oslo_concurrency.lockutils [None req-96ff1db2-64c7-4b5c-9a9f-bee0ad8fb44c None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69961) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  674.304600] env[69961]: DEBUG oslo_concurrency.lockutils [None req-96ff1db2-64c7-4b5c-9a9f-bee0ad8fb44c None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69961) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  674.304873] env[69961]: DEBUG oslo_concurrency.lockutils [None req-96ff1db2-64c7-4b5c-9a9f-bee0ad8fb44c None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69961) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  674.314356] env[69961]: DEBUG oslo_concurrency.lockutils [None req-96ff1db2-64c7-4b5c-9a9f-bee0ad8fb44c None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69961) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  674.314611] env[69961]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-96ff1db2-64c7-4b5c-9a9f-bee0ad8fb44c None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  674.314754] env[69961]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-96ff1db2-64c7-4b5c-9a9f-bee0ad8fb44c None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=69961) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  676.317358] env[69961]: CRITICAL neutron [None req-96ff1db2-64c7-4b5c-9a9f-bee0ad8fb44c None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  676.317358] env[69961]: ERROR neutron Traceback (most recent call last):
[  676.317358] env[69961]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  676.317358] env[69961]: ERROR neutron     sys.exit(main())
[  676.317358] env[69961]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  676.317358] env[69961]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  676.317358] env[69961]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  676.317358] env[69961]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  676.317358] env[69961]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  676.317358] env[69961]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  676.317358] env[69961]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  676.317358] env[69961]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  676.317358] env[69961]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  676.317358] env[69961]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  676.317358] env[69961]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  676.317358] env[69961]: ERROR neutron     response = self.get(path=path, params=params)
[  676.318128] env[69961]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  676.318128] env[69961]: ERROR neutron     raise RuntimeError(msg, last_err)
[  676.318128] env[69961]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  676.318128] env[69961]: ERROR neutron 
[  678.942094] env[70127]: INFO neutron.common.config [-] Logging enabled!
[  678.942447] env[70127]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  678.942607] env[70127]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=70127) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  678.942908] env[70127]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  678.942943] env[70127]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  678.943748] env[70127]: WARNING oslo_policy.policy [None req-61081c86-8d6e-4eca-86fa-281fdb2cce43 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  678.943983] env[70127]: WARNING oslo_policy.policy [None req-61081c86-8d6e-4eca-86fa-281fdb2cce43 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  678.945194] env[70127]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-61081c86-8d6e-4eca-86fa-281fdb2cce43 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  678.959655] env[70127]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-61081c86-8d6e-4eca-86fa-281fdb2cce43 None None] Session token - acquiring
[  678.960504] env[70127]: DEBUG networking_nsxv3.common.locking [None req-61081c86-8d6e-4eca-86fa-281fdb2cce43 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=70127) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  678.960696] env[70127]: DEBUG oslo_concurrency.lockutils [None req-61081c86-8d6e-4eca-86fa-281fdb2cce43 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70127) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  678.960819] env[70127]: DEBUG oslo_concurrency.lockutils [None req-61081c86-8d6e-4eca-86fa-281fdb2cce43 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70127) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  678.961191] env[70127]: DEBUG oslo_concurrency.lockutils [None req-61081c86-8d6e-4eca-86fa-281fdb2cce43 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70127) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  678.970083] env[70127]: DEBUG oslo_concurrency.lockutils [None req-61081c86-8d6e-4eca-86fa-281fdb2cce43 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70127) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  678.970339] env[70127]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-61081c86-8d6e-4eca-86fa-281fdb2cce43 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  678.970484] env[70127]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-61081c86-8d6e-4eca-86fa-281fdb2cce43 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=70127) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  680.976832] env[70127]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-61081c86-8d6e-4eca-86fa-281fdb2cce43 None None] Session token - acquiring
[  680.977174] env[70127]: DEBUG networking_nsxv3.common.locking [None req-61081c86-8d6e-4eca-86fa-281fdb2cce43 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=70127) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  680.977368] env[70127]: DEBUG oslo_concurrency.lockutils [None req-61081c86-8d6e-4eca-86fa-281fdb2cce43 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70127) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  680.977597] env[70127]: DEBUG oslo_concurrency.lockutils [None req-61081c86-8d6e-4eca-86fa-281fdb2cce43 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70127) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  680.977850] env[70127]: DEBUG oslo_concurrency.lockutils [None req-61081c86-8d6e-4eca-86fa-281fdb2cce43 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70127) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  680.987269] env[70127]: DEBUG oslo_concurrency.lockutils [None req-61081c86-8d6e-4eca-86fa-281fdb2cce43 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70127) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  680.987522] env[70127]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-61081c86-8d6e-4eca-86fa-281fdb2cce43 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  680.987663] env[70127]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-61081c86-8d6e-4eca-86fa-281fdb2cce43 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=70127) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  682.989807] env[70127]: CRITICAL neutron [None req-61081c86-8d6e-4eca-86fa-281fdb2cce43 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  682.989807] env[70127]: ERROR neutron Traceback (most recent call last):
[  682.989807] env[70127]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  682.989807] env[70127]: ERROR neutron     sys.exit(main())
[  682.989807] env[70127]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  682.989807] env[70127]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  682.989807] env[70127]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  682.989807] env[70127]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  682.989807] env[70127]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  682.989807] env[70127]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  682.989807] env[70127]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  682.989807] env[70127]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  682.989807] env[70127]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  682.989807] env[70127]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  682.989807] env[70127]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  682.989807] env[70127]: ERROR neutron     response = self.get(path=path, params=params)
[  682.990503] env[70127]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  682.990503] env[70127]: ERROR neutron     raise RuntimeError(msg, last_err)
[  682.990503] env[70127]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  682.990503] env[70127]: ERROR neutron 
[  685.686409] env[70252]: INFO neutron.common.config [-] Logging enabled!
[  685.686736] env[70252]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  685.686958] env[70252]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=70252) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  685.687191] env[70252]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  685.687288] env[70252]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  685.688145] env[70252]: WARNING oslo_policy.policy [None req-539d4e2b-3a24-482f-a617-474f04a4d9f7 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  685.688377] env[70252]: WARNING oslo_policy.policy [None req-539d4e2b-3a24-482f-a617-474f04a4d9f7 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  685.689586] env[70252]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-539d4e2b-3a24-482f-a617-474f04a4d9f7 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  685.703893] env[70252]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-539d4e2b-3a24-482f-a617-474f04a4d9f7 None None] Session token - acquiring
[  685.704692] env[70252]: DEBUG networking_nsxv3.common.locking [None req-539d4e2b-3a24-482f-a617-474f04a4d9f7 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=70252) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  685.704893] env[70252]: DEBUG oslo_concurrency.lockutils [None req-539d4e2b-3a24-482f-a617-474f04a4d9f7 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70252) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  685.705022] env[70252]: DEBUG oslo_concurrency.lockutils [None req-539d4e2b-3a24-482f-a617-474f04a4d9f7 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70252) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  685.705382] env[70252]: DEBUG oslo_concurrency.lockutils [None req-539d4e2b-3a24-482f-a617-474f04a4d9f7 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70252) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  685.714475] env[70252]: DEBUG oslo_concurrency.lockutils [None req-539d4e2b-3a24-482f-a617-474f04a4d9f7 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70252) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  685.714732] env[70252]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-539d4e2b-3a24-482f-a617-474f04a4d9f7 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  685.714882] env[70252]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-539d4e2b-3a24-482f-a617-474f04a4d9f7 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=70252) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  687.720993] env[70252]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-539d4e2b-3a24-482f-a617-474f04a4d9f7 None None] Session token - acquiring
[  687.721427] env[70252]: DEBUG networking_nsxv3.common.locking [None req-539d4e2b-3a24-482f-a617-474f04a4d9f7 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=70252) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  687.721686] env[70252]: DEBUG oslo_concurrency.lockutils [None req-539d4e2b-3a24-482f-a617-474f04a4d9f7 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70252) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  687.721764] env[70252]: DEBUG oslo_concurrency.lockutils [None req-539d4e2b-3a24-482f-a617-474f04a4d9f7 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70252) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  687.722057] env[70252]: DEBUG oslo_concurrency.lockutils [None req-539d4e2b-3a24-482f-a617-474f04a4d9f7 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70252) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  687.731338] env[70252]: DEBUG oslo_concurrency.lockutils [None req-539d4e2b-3a24-482f-a617-474f04a4d9f7 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70252) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  687.731644] env[70252]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-539d4e2b-3a24-482f-a617-474f04a4d9f7 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  687.731795] env[70252]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-539d4e2b-3a24-482f-a617-474f04a4d9f7 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=70252) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  689.732895] env[70252]: CRITICAL neutron [None req-539d4e2b-3a24-482f-a617-474f04a4d9f7 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  689.732895] env[70252]: ERROR neutron Traceback (most recent call last):
[  689.732895] env[70252]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  689.732895] env[70252]: ERROR neutron     sys.exit(main())
[  689.732895] env[70252]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  689.732895] env[70252]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  689.732895] env[70252]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  689.732895] env[70252]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  689.732895] env[70252]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  689.732895] env[70252]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  689.732895] env[70252]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  689.732895] env[70252]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  689.732895] env[70252]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  689.732895] env[70252]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  689.732895] env[70252]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  689.732895] env[70252]: ERROR neutron     response = self.get(path=path, params=params)
[  689.733632] env[70252]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  689.733632] env[70252]: ERROR neutron     raise RuntimeError(msg, last_err)
[  689.733632] env[70252]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  689.733632] env[70252]: ERROR neutron 
[  692.286559] env[70373]: INFO neutron.common.config [-] Logging enabled!
[  692.286894] env[70373]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  692.287061] env[70373]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=70373) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  692.287313] env[70373]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  692.287403] env[70373]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  692.288307] env[70373]: WARNING oslo_policy.policy [None req-3d3e33b5-649b-4cf3-b075-4ffa37188b97 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  692.288537] env[70373]: WARNING oslo_policy.policy [None req-3d3e33b5-649b-4cf3-b075-4ffa37188b97 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  692.289769] env[70373]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-3d3e33b5-649b-4cf3-b075-4ffa37188b97 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  692.305307] env[70373]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3d3e33b5-649b-4cf3-b075-4ffa37188b97 None None] Session token - acquiring
[  692.305307] env[70373]: DEBUG networking_nsxv3.common.locking [None req-3d3e33b5-649b-4cf3-b075-4ffa37188b97 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=70373) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  692.305307] env[70373]: DEBUG oslo_concurrency.lockutils [None req-3d3e33b5-649b-4cf3-b075-4ffa37188b97 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  692.305728] env[70373]: DEBUG oslo_concurrency.lockutils [None req-3d3e33b5-649b-4cf3-b075-4ffa37188b97 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  692.305728] env[70373]: DEBUG oslo_concurrency.lockutils [None req-3d3e33b5-649b-4cf3-b075-4ffa37188b97 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  692.315526] env[70373]: DEBUG oslo_concurrency.lockutils [None req-3d3e33b5-649b-4cf3-b075-4ffa37188b97 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  692.315859] env[70373]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3d3e33b5-649b-4cf3-b075-4ffa37188b97 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  692.316087] env[70373]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3d3e33b5-649b-4cf3-b075-4ffa37188b97 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=70373) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  694.322250] env[70373]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3d3e33b5-649b-4cf3-b075-4ffa37188b97 None None] Session token - acquiring
[  694.322537] env[70373]: DEBUG networking_nsxv3.common.locking [None req-3d3e33b5-649b-4cf3-b075-4ffa37188b97 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=70373) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  694.322605] env[70373]: DEBUG oslo_concurrency.lockutils [None req-3d3e33b5-649b-4cf3-b075-4ffa37188b97 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  694.322726] env[70373]: DEBUG oslo_concurrency.lockutils [None req-3d3e33b5-649b-4cf3-b075-4ffa37188b97 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  694.323008] env[70373]: DEBUG oslo_concurrency.lockutils [None req-3d3e33b5-649b-4cf3-b075-4ffa37188b97 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  694.332110] env[70373]: DEBUG oslo_concurrency.lockutils [None req-3d3e33b5-649b-4cf3-b075-4ffa37188b97 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  694.332376] env[70373]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3d3e33b5-649b-4cf3-b075-4ffa37188b97 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  694.332513] env[70373]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3d3e33b5-649b-4cf3-b075-4ffa37188b97 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=70373) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  696.334944] env[70373]: CRITICAL neutron [None req-3d3e33b5-649b-4cf3-b075-4ffa37188b97 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  696.334944] env[70373]: ERROR neutron Traceback (most recent call last):
[  696.334944] env[70373]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  696.334944] env[70373]: ERROR neutron     sys.exit(main())
[  696.334944] env[70373]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  696.334944] env[70373]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  696.334944] env[70373]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  696.334944] env[70373]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  696.334944] env[70373]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  696.334944] env[70373]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  696.334944] env[70373]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  696.334944] env[70373]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  696.334944] env[70373]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  696.334944] env[70373]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  696.334944] env[70373]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  696.334944] env[70373]: ERROR neutron     response = self.get(path=path, params=params)
[  696.335692] env[70373]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  696.335692] env[70373]: ERROR neutron     raise RuntimeError(msg, last_err)
[  696.335692] env[70373]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  696.335692] env[70373]: ERROR neutron 
[  699.087377] env[70493]: INFO neutron.common.config [-] Logging enabled!
[  699.087377] env[70493]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  699.087930] env[70493]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=70493) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  699.088238] env[70493]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  699.088401] env[70493]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  699.089801] env[70493]: WARNING oslo_policy.policy [None req-5da0a7e0-dbeb-4f40-b14b-8331e93759a6 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  699.090073] env[70493]: WARNING oslo_policy.policy [None req-5da0a7e0-dbeb-4f40-b14b-8331e93759a6 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  699.091784] env[70493]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-5da0a7e0-dbeb-4f40-b14b-8331e93759a6 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  699.121534] env[70493]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5da0a7e0-dbeb-4f40-b14b-8331e93759a6 None None] Session token - acquiring
[  699.129331] env[70493]: DEBUG networking_nsxv3.common.locking [None req-5da0a7e0-dbeb-4f40-b14b-8331e93759a6 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=70493) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  699.129618] env[70493]: DEBUG oslo_concurrency.lockutils [None req-5da0a7e0-dbeb-4f40-b14b-8331e93759a6 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70493) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  699.129752] env[70493]: DEBUG oslo_concurrency.lockutils [None req-5da0a7e0-dbeb-4f40-b14b-8331e93759a6 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70493) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  699.130222] env[70493]: DEBUG oslo_concurrency.lockutils [None req-5da0a7e0-dbeb-4f40-b14b-8331e93759a6 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70493) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  699.141031] env[70493]: DEBUG oslo_concurrency.lockutils [None req-5da0a7e0-dbeb-4f40-b14b-8331e93759a6 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70493) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  699.141158] env[70493]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5da0a7e0-dbeb-4f40-b14b-8331e93759a6 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  699.142208] env[70493]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5da0a7e0-dbeb-4f40-b14b-8331e93759a6 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=70493) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  701.150077] env[70493]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5da0a7e0-dbeb-4f40-b14b-8331e93759a6 None None] Session token - acquiring
[  701.150337] env[70493]: DEBUG networking_nsxv3.common.locking [None req-5da0a7e0-dbeb-4f40-b14b-8331e93759a6 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=70493) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  701.150405] env[70493]: DEBUG oslo_concurrency.lockutils [None req-5da0a7e0-dbeb-4f40-b14b-8331e93759a6 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70493) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  701.152063] env[70493]: DEBUG oslo_concurrency.lockutils [None req-5da0a7e0-dbeb-4f40-b14b-8331e93759a6 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70493) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  701.152063] env[70493]: DEBUG oslo_concurrency.lockutils [None req-5da0a7e0-dbeb-4f40-b14b-8331e93759a6 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70493) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  701.163543] env[70493]: DEBUG oslo_concurrency.lockutils [None req-5da0a7e0-dbeb-4f40-b14b-8331e93759a6 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70493) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  701.163972] env[70493]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5da0a7e0-dbeb-4f40-b14b-8331e93759a6 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  701.163972] env[70493]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5da0a7e0-dbeb-4f40-b14b-8331e93759a6 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=70493) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  703.164996] env[70493]: CRITICAL neutron [None req-5da0a7e0-dbeb-4f40-b14b-8331e93759a6 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  703.164996] env[70493]: ERROR neutron Traceback (most recent call last):
[  703.164996] env[70493]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  703.164996] env[70493]: ERROR neutron     sys.exit(main())
[  703.164996] env[70493]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  703.164996] env[70493]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  703.164996] env[70493]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  703.164996] env[70493]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  703.164996] env[70493]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  703.164996] env[70493]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  703.164996] env[70493]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  703.164996] env[70493]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  703.164996] env[70493]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  703.164996] env[70493]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  703.164996] env[70493]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  703.164996] env[70493]: ERROR neutron     response = self.get(path=path, params=params)
[  703.165629] env[70493]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  703.165629] env[70493]: ERROR neutron     raise RuntimeError(msg, last_err)
[  703.165629] env[70493]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  703.165629] env[70493]: ERROR neutron 
[  706.097631] env[70817]: INFO neutron.common.config [-] Logging enabled!
[  706.097840] env[70817]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  706.098180] env[70817]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=70817) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  706.098431] env[70817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  706.098506] env[70817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  706.099446] env[70817]: WARNING oslo_policy.policy [None req-fbc98460-89ab-4d74-9a09-9759e18ff41e None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  706.099709] env[70817]: WARNING oslo_policy.policy [None req-fbc98460-89ab-4d74-9a09-9759e18ff41e None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  706.101024] env[70817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-fbc98460-89ab-4d74-9a09-9759e18ff41e None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  706.115432] env[70817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-fbc98460-89ab-4d74-9a09-9759e18ff41e None None] Session token - acquiring
[  706.116218] env[70817]: DEBUG networking_nsxv3.common.locking [None req-fbc98460-89ab-4d74-9a09-9759e18ff41e None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=70817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  706.116421] env[70817]: DEBUG oslo_concurrency.lockutils [None req-fbc98460-89ab-4d74-9a09-9759e18ff41e None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  706.116549] env[70817]: DEBUG oslo_concurrency.lockutils [None req-fbc98460-89ab-4d74-9a09-9759e18ff41e None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  706.116917] env[70817]: DEBUG oslo_concurrency.lockutils [None req-fbc98460-89ab-4d74-9a09-9759e18ff41e None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  706.126094] env[70817]: DEBUG oslo_concurrency.lockutils [None req-fbc98460-89ab-4d74-9a09-9759e18ff41e None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  706.126351] env[70817]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-fbc98460-89ab-4d74-9a09-9759e18ff41e None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  706.126497] env[70817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-fbc98460-89ab-4d74-9a09-9759e18ff41e None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=70817) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  708.133243] env[70817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-fbc98460-89ab-4d74-9a09-9759e18ff41e None None] Session token - acquiring
[  708.133616] env[70817]: DEBUG networking_nsxv3.common.locking [None req-fbc98460-89ab-4d74-9a09-9759e18ff41e None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=70817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  708.133733] env[70817]: DEBUG oslo_concurrency.lockutils [None req-fbc98460-89ab-4d74-9a09-9759e18ff41e None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  708.133857] env[70817]: DEBUG oslo_concurrency.lockutils [None req-fbc98460-89ab-4d74-9a09-9759e18ff41e None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  708.134271] env[70817]: DEBUG oslo_concurrency.lockutils [None req-fbc98460-89ab-4d74-9a09-9759e18ff41e None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  708.143855] env[70817]: DEBUG oslo_concurrency.lockutils [None req-fbc98460-89ab-4d74-9a09-9759e18ff41e None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  708.144119] env[70817]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-fbc98460-89ab-4d74-9a09-9759e18ff41e None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  708.144267] env[70817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-fbc98460-89ab-4d74-9a09-9759e18ff41e None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=70817) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  710.147160] env[70817]: CRITICAL neutron [None req-fbc98460-89ab-4d74-9a09-9759e18ff41e None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  710.147160] env[70817]: ERROR neutron Traceback (most recent call last):
[  710.147160] env[70817]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  710.147160] env[70817]: ERROR neutron     sys.exit(main())
[  710.147160] env[70817]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  710.147160] env[70817]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  710.147160] env[70817]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  710.147160] env[70817]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  710.147160] env[70817]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  710.147160] env[70817]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  710.147160] env[70817]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  710.147160] env[70817]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  710.147160] env[70817]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  710.147160] env[70817]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  710.147160] env[70817]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  710.147160] env[70817]: ERROR neutron     response = self.get(path=path, params=params)
[  710.147942] env[70817]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  710.147942] env[70817]: ERROR neutron     raise RuntimeError(msg, last_err)
[  710.147942] env[70817]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  710.147942] env[70817]: ERROR neutron 
[  712.687224] env[71057]: INFO neutron.common.config [-] Logging enabled!
[  712.687594] env[71057]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  712.687833] env[71057]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=71057) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  712.688121] env[71057]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  712.688223] env[71057]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  712.689109] env[71057]: WARNING oslo_policy.policy [None req-3b25046b-129f-4480-8c89-48124da6e30f None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  712.689331] env[71057]: WARNING oslo_policy.policy [None req-3b25046b-129f-4480-8c89-48124da6e30f None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  712.690614] env[71057]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-3b25046b-129f-4480-8c89-48124da6e30f None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  712.706101] env[71057]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3b25046b-129f-4480-8c89-48124da6e30f None None] Session token - acquiring
[  712.706959] env[71057]: DEBUG networking_nsxv3.common.locking [None req-3b25046b-129f-4480-8c89-48124da6e30f None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=71057) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  712.707183] env[71057]: DEBUG oslo_concurrency.lockutils [None req-3b25046b-129f-4480-8c89-48124da6e30f None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71057) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  712.707313] env[71057]: DEBUG oslo_concurrency.lockutils [None req-3b25046b-129f-4480-8c89-48124da6e30f None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71057) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  712.707698] env[71057]: DEBUG oslo_concurrency.lockutils [None req-3b25046b-129f-4480-8c89-48124da6e30f None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71057) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  712.717250] env[71057]: DEBUG oslo_concurrency.lockutils [None req-3b25046b-129f-4480-8c89-48124da6e30f None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71057) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  712.717620] env[71057]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3b25046b-129f-4480-8c89-48124da6e30f None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  712.717883] env[71057]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3b25046b-129f-4480-8c89-48124da6e30f None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=71057) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  714.726751] env[71057]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3b25046b-129f-4480-8c89-48124da6e30f None None] Session token - acquiring
[  714.726751] env[71057]: DEBUG networking_nsxv3.common.locking [None req-3b25046b-129f-4480-8c89-48124da6e30f None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=71057) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  714.727307] env[71057]: DEBUG oslo_concurrency.lockutils [None req-3b25046b-129f-4480-8c89-48124da6e30f None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71057) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  714.727562] env[71057]: DEBUG oslo_concurrency.lockutils [None req-3b25046b-129f-4480-8c89-48124da6e30f None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71057) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  714.727936] env[71057]: DEBUG oslo_concurrency.lockutils [None req-3b25046b-129f-4480-8c89-48124da6e30f None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71057) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  714.738594] env[71057]: DEBUG oslo_concurrency.lockutils [None req-3b25046b-129f-4480-8c89-48124da6e30f None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71057) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  714.738984] env[71057]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3b25046b-129f-4480-8c89-48124da6e30f None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  714.739285] env[71057]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3b25046b-129f-4480-8c89-48124da6e30f None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=71057) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  716.742119] env[71057]: CRITICAL neutron [None req-3b25046b-129f-4480-8c89-48124da6e30f None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  716.742119] env[71057]: ERROR neutron Traceback (most recent call last):
[  716.742119] env[71057]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  716.742119] env[71057]: ERROR neutron     sys.exit(main())
[  716.742119] env[71057]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  716.742119] env[71057]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  716.742119] env[71057]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  716.742119] env[71057]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  716.742119] env[71057]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  716.742119] env[71057]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  716.742119] env[71057]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  716.742119] env[71057]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  716.742119] env[71057]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  716.742119] env[71057]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  716.742119] env[71057]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  716.742119] env[71057]: ERROR neutron     response = self.get(path=path, params=params)
[  716.742991] env[71057]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  716.742991] env[71057]: ERROR neutron     raise RuntimeError(msg, last_err)
[  716.742991] env[71057]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  716.742991] env[71057]: ERROR neutron 
[  719.487007] env[71192]: INFO neutron.common.config [-] Logging enabled!
[  719.487373] env[71192]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  719.488268] env[71192]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=71192) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  719.488268] env[71192]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  719.488268] env[71192]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  719.488775] env[71192]: WARNING oslo_policy.policy [None req-a0ddc89c-0dd6-4bf8-9cdd-214dd374eea6 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  719.488938] env[71192]: WARNING oslo_policy.policy [None req-a0ddc89c-0dd6-4bf8-9cdd-214dd374eea6 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  719.490199] env[71192]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-a0ddc89c-0dd6-4bf8-9cdd-214dd374eea6 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  719.506248] env[71192]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-a0ddc89c-0dd6-4bf8-9cdd-214dd374eea6 None None] Session token - acquiring
[  719.507255] env[71192]: DEBUG networking_nsxv3.common.locking [None req-a0ddc89c-0dd6-4bf8-9cdd-214dd374eea6 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=71192) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  719.507467] env[71192]: DEBUG oslo_concurrency.lockutils [None req-a0ddc89c-0dd6-4bf8-9cdd-214dd374eea6 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71192) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  719.507653] env[71192]: DEBUG oslo_concurrency.lockutils [None req-a0ddc89c-0dd6-4bf8-9cdd-214dd374eea6 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71192) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  719.509054] env[71192]: DEBUG oslo_concurrency.lockutils [None req-a0ddc89c-0dd6-4bf8-9cdd-214dd374eea6 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71192) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  719.524070] env[71192]: DEBUG oslo_concurrency.lockutils [None req-a0ddc89c-0dd6-4bf8-9cdd-214dd374eea6 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71192) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  719.524502] env[71192]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-a0ddc89c-0dd6-4bf8-9cdd-214dd374eea6 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  719.524692] env[71192]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-a0ddc89c-0dd6-4bf8-9cdd-214dd374eea6 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=71192) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  721.530763] env[71192]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-a0ddc89c-0dd6-4bf8-9cdd-214dd374eea6 None None] Session token - acquiring
[  721.531110] env[71192]: DEBUG networking_nsxv3.common.locking [None req-a0ddc89c-0dd6-4bf8-9cdd-214dd374eea6 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=71192) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  721.531346] env[71192]: DEBUG oslo_concurrency.lockutils [None req-a0ddc89c-0dd6-4bf8-9cdd-214dd374eea6 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71192) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  721.531480] env[71192]: DEBUG oslo_concurrency.lockutils [None req-a0ddc89c-0dd6-4bf8-9cdd-214dd374eea6 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71192) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  721.531753] env[71192]: DEBUG oslo_concurrency.lockutils [None req-a0ddc89c-0dd6-4bf8-9cdd-214dd374eea6 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71192) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  721.540605] env[71192]: DEBUG oslo_concurrency.lockutils [None req-a0ddc89c-0dd6-4bf8-9cdd-214dd374eea6 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71192) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  721.540841] env[71192]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-a0ddc89c-0dd6-4bf8-9cdd-214dd374eea6 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  721.540975] env[71192]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-a0ddc89c-0dd6-4bf8-9cdd-214dd374eea6 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=71192) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  723.544054] env[71192]: CRITICAL neutron [None req-a0ddc89c-0dd6-4bf8-9cdd-214dd374eea6 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  723.544054] env[71192]: ERROR neutron Traceback (most recent call last):
[  723.544054] env[71192]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  723.544054] env[71192]: ERROR neutron     sys.exit(main())
[  723.544054] env[71192]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  723.544054] env[71192]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  723.544054] env[71192]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  723.544054] env[71192]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  723.544054] env[71192]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  723.544054] env[71192]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  723.544054] env[71192]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  723.544054] env[71192]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  723.544054] env[71192]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  723.544054] env[71192]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  723.544054] env[71192]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  723.544054] env[71192]: ERROR neutron     response = self.get(path=path, params=params)
[  723.545004] env[71192]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  723.545004] env[71192]: ERROR neutron     raise RuntimeError(msg, last_err)
[  723.545004] env[71192]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  723.545004] env[71192]: ERROR neutron 
[  726.264551] env[71310]: INFO neutron.common.config [-] Logging enabled!
[  726.264899] env[71310]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  726.265112] env[71310]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=71310) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  726.265382] env[71310]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  726.265494] env[71310]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  726.266393] env[71310]: WARNING oslo_policy.policy [None req-6a6e9b37-2c63-4fcf-9cf3-4291e3a6fd59 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  726.266807] env[71310]: WARNING oslo_policy.policy [None req-6a6e9b37-2c63-4fcf-9cf3-4291e3a6fd59 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  726.268037] env[71310]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-6a6e9b37-2c63-4fcf-9cf3-4291e3a6fd59 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  726.284826] env[71310]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-6a6e9b37-2c63-4fcf-9cf3-4291e3a6fd59 None None] Session token - acquiring
[  726.285735] env[71310]: DEBUG networking_nsxv3.common.locking [None req-6a6e9b37-2c63-4fcf-9cf3-4291e3a6fd59 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=71310) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  726.285957] env[71310]: DEBUG oslo_concurrency.lockutils [None req-6a6e9b37-2c63-4fcf-9cf3-4291e3a6fd59 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71310) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  726.286102] env[71310]: DEBUG oslo_concurrency.lockutils [None req-6a6e9b37-2c63-4fcf-9cf3-4291e3a6fd59 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71310) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  726.286506] env[71310]: DEBUG oslo_concurrency.lockutils [None req-6a6e9b37-2c63-4fcf-9cf3-4291e3a6fd59 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71310) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  726.296176] env[71310]: DEBUG oslo_concurrency.lockutils [None req-6a6e9b37-2c63-4fcf-9cf3-4291e3a6fd59 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71310) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  726.296449] env[71310]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-6a6e9b37-2c63-4fcf-9cf3-4291e3a6fd59 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  726.296598] env[71310]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-6a6e9b37-2c63-4fcf-9cf3-4291e3a6fd59 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=71310) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  728.302897] env[71310]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-6a6e9b37-2c63-4fcf-9cf3-4291e3a6fd59 None None] Session token - acquiring
[  728.303211] env[71310]: DEBUG networking_nsxv3.common.locking [None req-6a6e9b37-2c63-4fcf-9cf3-4291e3a6fd59 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=71310) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  728.303393] env[71310]: DEBUG oslo_concurrency.lockutils [None req-6a6e9b37-2c63-4fcf-9cf3-4291e3a6fd59 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71310) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  728.303555] env[71310]: DEBUG oslo_concurrency.lockutils [None req-6a6e9b37-2c63-4fcf-9cf3-4291e3a6fd59 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71310) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  728.303835] env[71310]: DEBUG oslo_concurrency.lockutils [None req-6a6e9b37-2c63-4fcf-9cf3-4291e3a6fd59 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71310) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  728.313340] env[71310]: DEBUG oslo_concurrency.lockutils [None req-6a6e9b37-2c63-4fcf-9cf3-4291e3a6fd59 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71310) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  728.313587] env[71310]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-6a6e9b37-2c63-4fcf-9cf3-4291e3a6fd59 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  728.313733] env[71310]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-6a6e9b37-2c63-4fcf-9cf3-4291e3a6fd59 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=71310) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  730.317566] env[71310]: CRITICAL neutron [None req-6a6e9b37-2c63-4fcf-9cf3-4291e3a6fd59 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  730.317566] env[71310]: ERROR neutron Traceback (most recent call last):
[  730.317566] env[71310]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  730.317566] env[71310]: ERROR neutron     sys.exit(main())
[  730.317566] env[71310]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  730.317566] env[71310]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  730.317566] env[71310]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  730.317566] env[71310]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  730.317566] env[71310]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  730.317566] env[71310]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  730.317566] env[71310]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  730.317566] env[71310]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  730.317566] env[71310]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  730.317566] env[71310]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  730.317566] env[71310]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  730.317566] env[71310]: ERROR neutron     response = self.get(path=path, params=params)
[  730.319573] env[71310]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  730.319573] env[71310]: ERROR neutron     raise RuntimeError(msg, last_err)
[  730.319573] env[71310]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  730.319573] env[71310]: ERROR neutron 
[  733.142771] env[71523]: INFO neutron.common.config [-] Logging enabled!
[  733.143131] env[71523]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  733.143365] env[71523]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=71523) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  733.143623] env[71523]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  733.143688] env[71523]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  733.144818] env[71523]: WARNING oslo_policy.policy [None req-bc8f3cba-5475-48de-ad67-252541382bc8 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  733.145459] env[71523]: WARNING oslo_policy.policy [None req-bc8f3cba-5475-48de-ad67-252541382bc8 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  733.147552] env[71523]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-bc8f3cba-5475-48de-ad67-252541382bc8 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  733.168320] env[71523]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-bc8f3cba-5475-48de-ad67-252541382bc8 None None] Session token - acquiring
[  733.168320] env[71523]: DEBUG networking_nsxv3.common.locking [None req-bc8f3cba-5475-48de-ad67-252541382bc8 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=71523) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  733.168320] env[71523]: DEBUG oslo_concurrency.lockutils [None req-bc8f3cba-5475-48de-ad67-252541382bc8 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71523) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  733.168598] env[71523]: DEBUG oslo_concurrency.lockutils [None req-bc8f3cba-5475-48de-ad67-252541382bc8 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71523) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  733.168598] env[71523]: DEBUG oslo_concurrency.lockutils [None req-bc8f3cba-5475-48de-ad67-252541382bc8 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71523) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  733.176430] env[71523]: DEBUG oslo_concurrency.lockutils [None req-bc8f3cba-5475-48de-ad67-252541382bc8 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71523) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  733.176696] env[71523]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-bc8f3cba-5475-48de-ad67-252541382bc8 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  733.176838] env[71523]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-bc8f3cba-5475-48de-ad67-252541382bc8 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=71523) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  735.185431] env[71523]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-bc8f3cba-5475-48de-ad67-252541382bc8 None None] Session token - acquiring
[  735.185431] env[71523]: DEBUG networking_nsxv3.common.locking [None req-bc8f3cba-5475-48de-ad67-252541382bc8 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=71523) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  735.185431] env[71523]: DEBUG oslo_concurrency.lockutils [None req-bc8f3cba-5475-48de-ad67-252541382bc8 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71523) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  735.185886] env[71523]: DEBUG oslo_concurrency.lockutils [None req-bc8f3cba-5475-48de-ad67-252541382bc8 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71523) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  735.185886] env[71523]: DEBUG oslo_concurrency.lockutils [None req-bc8f3cba-5475-48de-ad67-252541382bc8 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71523) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  735.193484] env[71523]: DEBUG oslo_concurrency.lockutils [None req-bc8f3cba-5475-48de-ad67-252541382bc8 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71523) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  735.193836] env[71523]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-bc8f3cba-5475-48de-ad67-252541382bc8 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  735.194088] env[71523]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-bc8f3cba-5475-48de-ad67-252541382bc8 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=71523) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  737.197135] env[71523]: CRITICAL neutron [None req-bc8f3cba-5475-48de-ad67-252541382bc8 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  737.197135] env[71523]: ERROR neutron Traceback (most recent call last):
[  737.197135] env[71523]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  737.197135] env[71523]: ERROR neutron     sys.exit(main())
[  737.197135] env[71523]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  737.197135] env[71523]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  737.197135] env[71523]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  737.197135] env[71523]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  737.197135] env[71523]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  737.197135] env[71523]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  737.197135] env[71523]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  737.197135] env[71523]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  737.197135] env[71523]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  737.197135] env[71523]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  737.197135] env[71523]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  737.197135] env[71523]: ERROR neutron     response = self.get(path=path, params=params)
[  737.197935] env[71523]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  737.197935] env[71523]: ERROR neutron     raise RuntimeError(msg, last_err)
[  737.197935] env[71523]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  737.197935] env[71523]: ERROR neutron 
[  739.888200] env[71832]: INFO neutron.common.config [-] Logging enabled!
[  739.888534] env[71832]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  739.888713] env[71832]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=71832) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  739.888942] env[71832]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  739.889032] env[71832]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  739.889879] env[71832]: WARNING oslo_policy.policy [None req-1a948944-6e56-4f2e-8ee2-851cdcb587f2 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  739.890121] env[71832]: WARNING oslo_policy.policy [None req-1a948944-6e56-4f2e-8ee2-851cdcb587f2 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  739.891348] env[71832]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-1a948944-6e56-4f2e-8ee2-851cdcb587f2 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  739.905618] env[71832]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-1a948944-6e56-4f2e-8ee2-851cdcb587f2 None None] Session token - acquiring
[  739.906406] env[71832]: DEBUG networking_nsxv3.common.locking [None req-1a948944-6e56-4f2e-8ee2-851cdcb587f2 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=71832) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  739.906609] env[71832]: DEBUG oslo_concurrency.lockutils [None req-1a948944-6e56-4f2e-8ee2-851cdcb587f2 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71832) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  739.906739] env[71832]: DEBUG oslo_concurrency.lockutils [None req-1a948944-6e56-4f2e-8ee2-851cdcb587f2 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71832) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  739.907098] env[71832]: DEBUG oslo_concurrency.lockutils [None req-1a948944-6e56-4f2e-8ee2-851cdcb587f2 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71832) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  739.916125] env[71832]: DEBUG oslo_concurrency.lockutils [None req-1a948944-6e56-4f2e-8ee2-851cdcb587f2 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71832) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  739.916379] env[71832]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-1a948944-6e56-4f2e-8ee2-851cdcb587f2 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  739.916524] env[71832]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-1a948944-6e56-4f2e-8ee2-851cdcb587f2 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=71832) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  741.922495] env[71832]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-1a948944-6e56-4f2e-8ee2-851cdcb587f2 None None] Session token - acquiring
[  741.922921] env[71832]: DEBUG networking_nsxv3.common.locking [None req-1a948944-6e56-4f2e-8ee2-851cdcb587f2 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=71832) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  741.923123] env[71832]: DEBUG oslo_concurrency.lockutils [None req-1a948944-6e56-4f2e-8ee2-851cdcb587f2 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71832) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  741.923253] env[71832]: DEBUG oslo_concurrency.lockutils [None req-1a948944-6e56-4f2e-8ee2-851cdcb587f2 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71832) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  741.923518] env[71832]: DEBUG oslo_concurrency.lockutils [None req-1a948944-6e56-4f2e-8ee2-851cdcb587f2 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71832) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  741.932760] env[71832]: DEBUG oslo_concurrency.lockutils [None req-1a948944-6e56-4f2e-8ee2-851cdcb587f2 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71832) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  741.933038] env[71832]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-1a948944-6e56-4f2e-8ee2-851cdcb587f2 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  741.933967] env[71832]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-1a948944-6e56-4f2e-8ee2-851cdcb587f2 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=71832) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  743.936182] env[71832]: CRITICAL neutron [None req-1a948944-6e56-4f2e-8ee2-851cdcb587f2 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  743.936182] env[71832]: ERROR neutron Traceback (most recent call last):
[  743.936182] env[71832]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  743.936182] env[71832]: ERROR neutron     sys.exit(main())
[  743.936182] env[71832]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  743.936182] env[71832]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  743.936182] env[71832]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  743.936182] env[71832]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  743.936182] env[71832]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  743.936182] env[71832]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  743.936182] env[71832]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  743.936182] env[71832]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  743.936182] env[71832]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  743.936182] env[71832]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  743.936182] env[71832]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  743.936182] env[71832]: ERROR neutron     response = self.get(path=path, params=params)
[  743.936948] env[71832]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  743.936948] env[71832]: ERROR neutron     raise RuntimeError(msg, last_err)
[  743.936948] env[71832]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  743.936948] env[71832]: ERROR neutron 
[  746.793059] env[72026]: INFO neutron.common.config [-] Logging enabled!
[  746.793293] env[72026]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  746.793613] env[72026]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=72026) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  746.793843] env[72026]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  746.793939] env[72026]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  746.794803] env[72026]: WARNING oslo_policy.policy [None req-5553c650-fbf6-4749-babc-e6982baea32b None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  746.795025] env[72026]: WARNING oslo_policy.policy [None req-5553c650-fbf6-4749-babc-e6982baea32b None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  746.796412] env[72026]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-5553c650-fbf6-4749-babc-e6982baea32b None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  746.811599] env[72026]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5553c650-fbf6-4749-babc-e6982baea32b None None] Session token - acquiring
[  746.812450] env[72026]: DEBUG networking_nsxv3.common.locking [None req-5553c650-fbf6-4749-babc-e6982baea32b None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=72026) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  746.812649] env[72026]: DEBUG oslo_concurrency.lockutils [None req-5553c650-fbf6-4749-babc-e6982baea32b None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  746.812774] env[72026]: DEBUG oslo_concurrency.lockutils [None req-5553c650-fbf6-4749-babc-e6982baea32b None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  746.813165] env[72026]: DEBUG oslo_concurrency.lockutils [None req-5553c650-fbf6-4749-babc-e6982baea32b None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  746.822231] env[72026]: DEBUG oslo_concurrency.lockutils [None req-5553c650-fbf6-4749-babc-e6982baea32b None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  746.822478] env[72026]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5553c650-fbf6-4749-babc-e6982baea32b None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  746.822758] env[72026]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5553c650-fbf6-4749-babc-e6982baea32b None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=72026) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  748.828738] env[72026]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5553c650-fbf6-4749-babc-e6982baea32b None None] Session token - acquiring
[  748.829165] env[72026]: DEBUG networking_nsxv3.common.locking [None req-5553c650-fbf6-4749-babc-e6982baea32b None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=72026) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  748.829264] env[72026]: DEBUG oslo_concurrency.lockutils [None req-5553c650-fbf6-4749-babc-e6982baea32b None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  748.829390] env[72026]: DEBUG oslo_concurrency.lockutils [None req-5553c650-fbf6-4749-babc-e6982baea32b None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  748.829676] env[72026]: DEBUG oslo_concurrency.lockutils [None req-5553c650-fbf6-4749-babc-e6982baea32b None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  748.838701] env[72026]: DEBUG oslo_concurrency.lockutils [None req-5553c650-fbf6-4749-babc-e6982baea32b None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  748.838936] env[72026]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5553c650-fbf6-4749-babc-e6982baea32b None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  748.839077] env[72026]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5553c650-fbf6-4749-babc-e6982baea32b None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=72026) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  750.840911] env[72026]: CRITICAL neutron [None req-5553c650-fbf6-4749-babc-e6982baea32b None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  750.840911] env[72026]: ERROR neutron Traceback (most recent call last):
[  750.840911] env[72026]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  750.840911] env[72026]: ERROR neutron     sys.exit(main())
[  750.840911] env[72026]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  750.840911] env[72026]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  750.840911] env[72026]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  750.840911] env[72026]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  750.840911] env[72026]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  750.840911] env[72026]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  750.840911] env[72026]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  750.840911] env[72026]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  750.840911] env[72026]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  750.840911] env[72026]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  750.840911] env[72026]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  750.840911] env[72026]: ERROR neutron     response = self.get(path=path, params=params)
[  750.841686] env[72026]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  750.841686] env[72026]: ERROR neutron     raise RuntimeError(msg, last_err)
[  750.841686] env[72026]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  750.841686] env[72026]: ERROR neutron 
[  753.429564] env[72203]: INFO neutron.common.config [-] Logging enabled!
[  753.429989] env[72203]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  753.430088] env[72203]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=72203) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  753.430299] env[72203]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  753.430393] env[72203]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  753.431225] env[72203]: WARNING oslo_policy.policy [None req-8088caea-25d4-4ad3-9d35-1ea3c7f5dc1b None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  753.431439] env[72203]: WARNING oslo_policy.policy [None req-8088caea-25d4-4ad3-9d35-1ea3c7f5dc1b None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  753.432652] env[72203]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-8088caea-25d4-4ad3-9d35-1ea3c7f5dc1b None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  753.446705] env[72203]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-8088caea-25d4-4ad3-9d35-1ea3c7f5dc1b None None] Session token - acquiring
[  753.447455] env[72203]: DEBUG networking_nsxv3.common.locking [None req-8088caea-25d4-4ad3-9d35-1ea3c7f5dc1b None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=72203) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  753.447654] env[72203]: DEBUG oslo_concurrency.lockutils [None req-8088caea-25d4-4ad3-9d35-1ea3c7f5dc1b None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  753.447841] env[72203]: DEBUG oslo_concurrency.lockutils [None req-8088caea-25d4-4ad3-9d35-1ea3c7f5dc1b None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  753.448249] env[72203]: DEBUG oslo_concurrency.lockutils [None req-8088caea-25d4-4ad3-9d35-1ea3c7f5dc1b None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  753.456903] env[72203]: DEBUG oslo_concurrency.lockutils [None req-8088caea-25d4-4ad3-9d35-1ea3c7f5dc1b None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  753.457148] env[72203]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-8088caea-25d4-4ad3-9d35-1ea3c7f5dc1b None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  753.457291] env[72203]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-8088caea-25d4-4ad3-9d35-1ea3c7f5dc1b None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=72203) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  755.463456] env[72203]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-8088caea-25d4-4ad3-9d35-1ea3c7f5dc1b None None] Session token - acquiring
[  755.463805] env[72203]: DEBUG networking_nsxv3.common.locking [None req-8088caea-25d4-4ad3-9d35-1ea3c7f5dc1b None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=72203) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  755.464033] env[72203]: DEBUG oslo_concurrency.lockutils [None req-8088caea-25d4-4ad3-9d35-1ea3c7f5dc1b None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  755.464082] env[72203]: DEBUG oslo_concurrency.lockutils [None req-8088caea-25d4-4ad3-9d35-1ea3c7f5dc1b None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  755.464357] env[72203]: DEBUG oslo_concurrency.lockutils [None req-8088caea-25d4-4ad3-9d35-1ea3c7f5dc1b None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  755.473390] env[72203]: DEBUG oslo_concurrency.lockutils [None req-8088caea-25d4-4ad3-9d35-1ea3c7f5dc1b None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  755.473709] env[72203]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-8088caea-25d4-4ad3-9d35-1ea3c7f5dc1b None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  755.473783] env[72203]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-8088caea-25d4-4ad3-9d35-1ea3c7f5dc1b None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=72203) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  757.476690] env[72203]: CRITICAL neutron [None req-8088caea-25d4-4ad3-9d35-1ea3c7f5dc1b None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  757.476690] env[72203]: ERROR neutron Traceback (most recent call last):
[  757.476690] env[72203]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  757.476690] env[72203]: ERROR neutron     sys.exit(main())
[  757.476690] env[72203]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  757.476690] env[72203]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  757.476690] env[72203]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  757.476690] env[72203]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  757.476690] env[72203]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  757.476690] env[72203]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  757.476690] env[72203]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  757.476690] env[72203]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  757.476690] env[72203]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  757.476690] env[72203]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  757.476690] env[72203]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  757.476690] env[72203]: ERROR neutron     response = self.get(path=path, params=params)
[  757.477734] env[72203]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  757.477734] env[72203]: ERROR neutron     raise RuntimeError(msg, last_err)
[  757.477734] env[72203]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  757.477734] env[72203]: ERROR neutron 
[  759.879806] env[72323]: INFO neutron.common.config [-] Logging enabled!
[  759.880208] env[72323]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  759.880390] env[72323]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=72323) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  759.880718] env[72323]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  759.880718] env[72323]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  759.881910] env[72323]: WARNING oslo_policy.policy [None req-e054edd4-f0a4-4db1-8ebb-b4a1c53426c5 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  759.882363] env[72323]: WARNING oslo_policy.policy [None req-e054edd4-f0a4-4db1-8ebb-b4a1c53426c5 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  759.883619] env[72323]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-e054edd4-f0a4-4db1-8ebb-b4a1c53426c5 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  759.898044] env[72323]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e054edd4-f0a4-4db1-8ebb-b4a1c53426c5 None None] Session token - acquiring
[  759.898808] env[72323]: DEBUG networking_nsxv3.common.locking [None req-e054edd4-f0a4-4db1-8ebb-b4a1c53426c5 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=72323) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  759.899081] env[72323]: DEBUG oslo_concurrency.lockutils [None req-e054edd4-f0a4-4db1-8ebb-b4a1c53426c5 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72323) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  759.899370] env[72323]: DEBUG oslo_concurrency.lockutils [None req-e054edd4-f0a4-4db1-8ebb-b4a1c53426c5 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72323) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  759.899749] env[72323]: DEBUG oslo_concurrency.lockutils [None req-e054edd4-f0a4-4db1-8ebb-b4a1c53426c5 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72323) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  759.908998] env[72323]: DEBUG oslo_concurrency.lockutils [None req-e054edd4-f0a4-4db1-8ebb-b4a1c53426c5 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72323) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  759.909240] env[72323]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e054edd4-f0a4-4db1-8ebb-b4a1c53426c5 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  759.909423] env[72323]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e054edd4-f0a4-4db1-8ebb-b4a1c53426c5 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=72323) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  761.915589] env[72323]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e054edd4-f0a4-4db1-8ebb-b4a1c53426c5 None None] Session token - acquiring
[  761.916168] env[72323]: DEBUG networking_nsxv3.common.locking [None req-e054edd4-f0a4-4db1-8ebb-b4a1c53426c5 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=72323) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  761.916168] env[72323]: DEBUG oslo_concurrency.lockutils [None req-e054edd4-f0a4-4db1-8ebb-b4a1c53426c5 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72323) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  761.916284] env[72323]: DEBUG oslo_concurrency.lockutils [None req-e054edd4-f0a4-4db1-8ebb-b4a1c53426c5 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72323) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  761.916482] env[72323]: DEBUG oslo_concurrency.lockutils [None req-e054edd4-f0a4-4db1-8ebb-b4a1c53426c5 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72323) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  761.925926] env[72323]: DEBUG oslo_concurrency.lockutils [None req-e054edd4-f0a4-4db1-8ebb-b4a1c53426c5 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72323) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  761.926172] env[72323]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e054edd4-f0a4-4db1-8ebb-b4a1c53426c5 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  761.926314] env[72323]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e054edd4-f0a4-4db1-8ebb-b4a1c53426c5 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=72323) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  763.928943] env[72323]: CRITICAL neutron [None req-e054edd4-f0a4-4db1-8ebb-b4a1c53426c5 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  763.928943] env[72323]: ERROR neutron Traceback (most recent call last):
[  763.928943] env[72323]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  763.928943] env[72323]: ERROR neutron     sys.exit(main())
[  763.928943] env[72323]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  763.928943] env[72323]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  763.928943] env[72323]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  763.928943] env[72323]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  763.928943] env[72323]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  763.928943] env[72323]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  763.928943] env[72323]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  763.928943] env[72323]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  763.928943] env[72323]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  763.928943] env[72323]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  763.928943] env[72323]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  763.928943] env[72323]: ERROR neutron     response = self.get(path=path, params=params)
[  763.929772] env[72323]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  763.929772] env[72323]: ERROR neutron     raise RuntimeError(msg, last_err)
[  763.929772] env[72323]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  763.929772] env[72323]: ERROR neutron 
[  766.747808] env[72440]: INFO neutron.common.config [-] Logging enabled!
[  766.748138] env[72440]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  766.748645] env[72440]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=72440) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  766.748733] env[72440]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  766.748770] env[72440]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  766.749627] env[72440]: WARNING oslo_policy.policy [None req-2590591e-ea5d-4888-9a43-f58758777f33 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  766.749854] env[72440]: WARNING oslo_policy.policy [None req-2590591e-ea5d-4888-9a43-f58758777f33 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  766.751104] env[72440]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-2590591e-ea5d-4888-9a43-f58758777f33 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  766.765519] env[72440]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-2590591e-ea5d-4888-9a43-f58758777f33 None None] Session token - acquiring
[  766.766388] env[72440]: DEBUG networking_nsxv3.common.locking [None req-2590591e-ea5d-4888-9a43-f58758777f33 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=72440) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  766.766630] env[72440]: DEBUG oslo_concurrency.lockutils [None req-2590591e-ea5d-4888-9a43-f58758777f33 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72440) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  766.766795] env[72440]: DEBUG oslo_concurrency.lockutils [None req-2590591e-ea5d-4888-9a43-f58758777f33 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72440) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  766.767213] env[72440]: DEBUG oslo_concurrency.lockutils [None req-2590591e-ea5d-4888-9a43-f58758777f33 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72440) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  766.776490] env[72440]: DEBUG oslo_concurrency.lockutils [None req-2590591e-ea5d-4888-9a43-f58758777f33 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72440) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  766.776793] env[72440]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-2590591e-ea5d-4888-9a43-f58758777f33 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  766.776982] env[72440]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-2590591e-ea5d-4888-9a43-f58758777f33 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=72440) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  768.783153] env[72440]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-2590591e-ea5d-4888-9a43-f58758777f33 None None] Session token - acquiring
[  768.783449] env[72440]: DEBUG networking_nsxv3.common.locking [None req-2590591e-ea5d-4888-9a43-f58758777f33 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=72440) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  768.783599] env[72440]: DEBUG oslo_concurrency.lockutils [None req-2590591e-ea5d-4888-9a43-f58758777f33 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72440) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  768.783733] env[72440]: DEBUG oslo_concurrency.lockutils [None req-2590591e-ea5d-4888-9a43-f58758777f33 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72440) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  768.784023] env[72440]: DEBUG oslo_concurrency.lockutils [None req-2590591e-ea5d-4888-9a43-f58758777f33 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72440) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  768.794333] env[72440]: DEBUG oslo_concurrency.lockutils [None req-2590591e-ea5d-4888-9a43-f58758777f33 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72440) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  768.794333] env[72440]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-2590591e-ea5d-4888-9a43-f58758777f33 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  768.794333] env[72440]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-2590591e-ea5d-4888-9a43-f58758777f33 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=72440) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  770.796915] env[72440]: CRITICAL neutron [None req-2590591e-ea5d-4888-9a43-f58758777f33 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  770.796915] env[72440]: ERROR neutron Traceback (most recent call last):
[  770.796915] env[72440]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  770.796915] env[72440]: ERROR neutron     sys.exit(main())
[  770.796915] env[72440]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  770.796915] env[72440]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  770.796915] env[72440]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  770.796915] env[72440]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  770.796915] env[72440]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  770.796915] env[72440]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  770.796915] env[72440]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  770.796915] env[72440]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  770.796915] env[72440]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  770.796915] env[72440]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  770.796915] env[72440]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  770.796915] env[72440]: ERROR neutron     response = self.get(path=path, params=params)
[  770.797592] env[72440]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  770.797592] env[72440]: ERROR neutron     raise RuntimeError(msg, last_err)
[  770.797592] env[72440]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  770.797592] env[72440]: ERROR neutron 
[  773.442191] env[72573]: INFO neutron.common.config [-] Logging enabled!
[  773.442522] env[72573]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  773.442737] env[72573]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=72573) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  773.442966] env[72573]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  773.443064] env[72573]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  773.443924] env[72573]: WARNING oslo_policy.policy [None req-5771cf56-e032-4da2-b6e2-22eacc095592 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  773.444179] env[72573]: WARNING oslo_policy.policy [None req-5771cf56-e032-4da2-b6e2-22eacc095592 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  773.445402] env[72573]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-5771cf56-e032-4da2-b6e2-22eacc095592 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  773.459802] env[72573]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5771cf56-e032-4da2-b6e2-22eacc095592 None None] Session token - acquiring
[  773.460617] env[72573]: DEBUG networking_nsxv3.common.locking [None req-5771cf56-e032-4da2-b6e2-22eacc095592 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=72573) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  773.460831] env[72573]: DEBUG oslo_concurrency.lockutils [None req-5771cf56-e032-4da2-b6e2-22eacc095592 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72573) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  773.460964] env[72573]: DEBUG oslo_concurrency.lockutils [None req-5771cf56-e032-4da2-b6e2-22eacc095592 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72573) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  773.461327] env[72573]: DEBUG oslo_concurrency.lockutils [None req-5771cf56-e032-4da2-b6e2-22eacc095592 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72573) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  773.470399] env[72573]: DEBUG oslo_concurrency.lockutils [None req-5771cf56-e032-4da2-b6e2-22eacc095592 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72573) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  773.470659] env[72573]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5771cf56-e032-4da2-b6e2-22eacc095592 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  773.470805] env[72573]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5771cf56-e032-4da2-b6e2-22eacc095592 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=72573) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  775.476962] env[72573]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5771cf56-e032-4da2-b6e2-22eacc095592 None None] Session token - acquiring
[  775.477575] env[72573]: DEBUG networking_nsxv3.common.locking [None req-5771cf56-e032-4da2-b6e2-22eacc095592 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=72573) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  775.477575] env[72573]: DEBUG oslo_concurrency.lockutils [None req-5771cf56-e032-4da2-b6e2-22eacc095592 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72573) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  775.477746] env[72573]: DEBUG oslo_concurrency.lockutils [None req-5771cf56-e032-4da2-b6e2-22eacc095592 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72573) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  775.478023] env[72573]: DEBUG oslo_concurrency.lockutils [None req-5771cf56-e032-4da2-b6e2-22eacc095592 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72573) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  775.487301] env[72573]: DEBUG oslo_concurrency.lockutils [None req-5771cf56-e032-4da2-b6e2-22eacc095592 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72573) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  775.487546] env[72573]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5771cf56-e032-4da2-b6e2-22eacc095592 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  775.487686] env[72573]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5771cf56-e032-4da2-b6e2-22eacc095592 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=72573) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  777.490684] env[72573]: CRITICAL neutron [None req-5771cf56-e032-4da2-b6e2-22eacc095592 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  777.490684] env[72573]: ERROR neutron Traceback (most recent call last):
[  777.490684] env[72573]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  777.490684] env[72573]: ERROR neutron     sys.exit(main())
[  777.490684] env[72573]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  777.490684] env[72573]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  777.490684] env[72573]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  777.490684] env[72573]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  777.490684] env[72573]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  777.490684] env[72573]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  777.490684] env[72573]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  777.490684] env[72573]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  777.490684] env[72573]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  777.490684] env[72573]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  777.490684] env[72573]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  777.490684] env[72573]: ERROR neutron     response = self.get(path=path, params=params)
[  777.491489] env[72573]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  777.491489] env[72573]: ERROR neutron     raise RuntimeError(msg, last_err)
[  777.491489] env[72573]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  777.491489] env[72573]: ERROR neutron 
[  780.246990] env[72661]: INFO neutron.common.config [-] Logging enabled!
[  780.247239] env[72661]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  780.247563] env[72661]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=72661) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  780.247842] env[72661]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  780.247945] env[72661]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  780.248844] env[72661]: WARNING oslo_policy.policy [None req-61927e4b-c652-4520-894f-50c591877eba None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  780.249074] env[72661]: WARNING oslo_policy.policy [None req-61927e4b-c652-4520-894f-50c591877eba None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  780.250319] env[72661]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-61927e4b-c652-4520-894f-50c591877eba None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  780.264756] env[72661]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-61927e4b-c652-4520-894f-50c591877eba None None] Session token - acquiring
[  780.265558] env[72661]: DEBUG networking_nsxv3.common.locking [None req-61927e4b-c652-4520-894f-50c591877eba None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=72661) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  780.265751] env[72661]: DEBUG oslo_concurrency.lockutils [None req-61927e4b-c652-4520-894f-50c591877eba None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72661) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  780.265909] env[72661]: DEBUG oslo_concurrency.lockutils [None req-61927e4b-c652-4520-894f-50c591877eba None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72661) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  780.266257] env[72661]: DEBUG oslo_concurrency.lockutils [None req-61927e4b-c652-4520-894f-50c591877eba None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72661) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  780.275248] env[72661]: DEBUG oslo_concurrency.lockutils [None req-61927e4b-c652-4520-894f-50c591877eba None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72661) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  780.275531] env[72661]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-61927e4b-c652-4520-894f-50c591877eba None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  780.275635] env[72661]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-61927e4b-c652-4520-894f-50c591877eba None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=72661) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  782.281924] env[72661]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-61927e4b-c652-4520-894f-50c591877eba None None] Session token - acquiring
[  782.282274] env[72661]: DEBUG networking_nsxv3.common.locking [None req-61927e4b-c652-4520-894f-50c591877eba None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=72661) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  782.282450] env[72661]: DEBUG oslo_concurrency.lockutils [None req-61927e4b-c652-4520-894f-50c591877eba None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72661) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  782.282656] env[72661]: DEBUG oslo_concurrency.lockutils [None req-61927e4b-c652-4520-894f-50c591877eba None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72661) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  782.282913] env[72661]: DEBUG oslo_concurrency.lockutils [None req-61927e4b-c652-4520-894f-50c591877eba None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72661) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  782.293082] env[72661]: DEBUG oslo_concurrency.lockutils [None req-61927e4b-c652-4520-894f-50c591877eba None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72661) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  782.293349] env[72661]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-61927e4b-c652-4520-894f-50c591877eba None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  782.293489] env[72661]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-61927e4b-c652-4520-894f-50c591877eba None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=72661) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  784.296621] env[72661]: CRITICAL neutron [None req-61927e4b-c652-4520-894f-50c591877eba None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  784.296621] env[72661]: ERROR neutron Traceback (most recent call last):
[  784.296621] env[72661]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  784.296621] env[72661]: ERROR neutron     sys.exit(main())
[  784.296621] env[72661]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  784.296621] env[72661]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  784.296621] env[72661]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  784.296621] env[72661]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  784.296621] env[72661]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  784.296621] env[72661]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  784.296621] env[72661]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  784.296621] env[72661]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  784.296621] env[72661]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  784.296621] env[72661]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  784.296621] env[72661]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  784.296621] env[72661]: ERROR neutron     response = self.get(path=path, params=params)
[  784.297185] env[72661]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  784.297185] env[72661]: ERROR neutron     raise RuntimeError(msg, last_err)
[  784.297185] env[72661]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  784.297185] env[72661]: ERROR neutron 
[  787.011649] env[72850]: INFO neutron.common.config [-] Logging enabled!
[  787.011977] env[72850]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  787.012212] env[72850]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=72850) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  787.012458] env[72850]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  787.012554] env[72850]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  787.013410] env[72850]: WARNING oslo_policy.policy [None req-841e216c-3bec-4853-ac1f-08ce15512d70 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  787.013633] env[72850]: WARNING oslo_policy.policy [None req-841e216c-3bec-4853-ac1f-08ce15512d70 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  787.014894] env[72850]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-841e216c-3bec-4853-ac1f-08ce15512d70 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  787.029283] env[72850]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-841e216c-3bec-4853-ac1f-08ce15512d70 None None] Session token - acquiring
[  787.030151] env[72850]: DEBUG networking_nsxv3.common.locking [None req-841e216c-3bec-4853-ac1f-08ce15512d70 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=72850) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  787.030374] env[72850]: DEBUG oslo_concurrency.lockutils [None req-841e216c-3bec-4853-ac1f-08ce15512d70 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  787.030487] env[72850]: DEBUG oslo_concurrency.lockutils [None req-841e216c-3bec-4853-ac1f-08ce15512d70 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  787.030970] env[72850]: DEBUG oslo_concurrency.lockutils [None req-841e216c-3bec-4853-ac1f-08ce15512d70 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  787.040812] env[72850]: DEBUG oslo_concurrency.lockutils [None req-841e216c-3bec-4853-ac1f-08ce15512d70 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  787.041626] env[72850]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-841e216c-3bec-4853-ac1f-08ce15512d70 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  787.041802] env[72850]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-841e216c-3bec-4853-ac1f-08ce15512d70 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=72850) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  789.048199] env[72850]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-841e216c-3bec-4853-ac1f-08ce15512d70 None None] Session token - acquiring
[  789.048572] env[72850]: DEBUG networking_nsxv3.common.locking [None req-841e216c-3bec-4853-ac1f-08ce15512d70 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=72850) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  789.048793] env[72850]: DEBUG oslo_concurrency.lockutils [None req-841e216c-3bec-4853-ac1f-08ce15512d70 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  789.048922] env[72850]: DEBUG oslo_concurrency.lockutils [None req-841e216c-3bec-4853-ac1f-08ce15512d70 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  789.049200] env[72850]: DEBUG oslo_concurrency.lockutils [None req-841e216c-3bec-4853-ac1f-08ce15512d70 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  789.060546] env[72850]: DEBUG oslo_concurrency.lockutils [None req-841e216c-3bec-4853-ac1f-08ce15512d70 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  789.060876] env[72850]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-841e216c-3bec-4853-ac1f-08ce15512d70 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  789.061054] env[72850]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-841e216c-3bec-4853-ac1f-08ce15512d70 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=72850) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  791.064084] env[72850]: CRITICAL neutron [None req-841e216c-3bec-4853-ac1f-08ce15512d70 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  791.064084] env[72850]: ERROR neutron Traceback (most recent call last):
[  791.064084] env[72850]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  791.064084] env[72850]: ERROR neutron     sys.exit(main())
[  791.064084] env[72850]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  791.064084] env[72850]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  791.064084] env[72850]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  791.064084] env[72850]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  791.064084] env[72850]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  791.064084] env[72850]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  791.064084] env[72850]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  791.064084] env[72850]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  791.064084] env[72850]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  791.064084] env[72850]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  791.064084] env[72850]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  791.064084] env[72850]: ERROR neutron     response = self.get(path=path, params=params)
[  791.064873] env[72850]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  791.064873] env[72850]: ERROR neutron     raise RuntimeError(msg, last_err)
[  791.064873] env[72850]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  791.064873] env[72850]: ERROR neutron 
[  793.833681] env[73002]: INFO neutron.common.config [-] Logging enabled!
[  793.833981] env[73002]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  793.834217] env[73002]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=73002) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  793.834466] env[73002]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  793.834560] env[73002]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  793.835466] env[73002]: WARNING oslo_policy.policy [None req-9e455680-6837-4025-aebe-79b7b497e11d None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  793.835671] env[73002]: WARNING oslo_policy.policy [None req-9e455680-6837-4025-aebe-79b7b497e11d None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  793.836901] env[73002]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-9e455680-6837-4025-aebe-79b7b497e11d None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  793.851691] env[73002]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-9e455680-6837-4025-aebe-79b7b497e11d None None] Session token - acquiring
[  793.852576] env[73002]: DEBUG networking_nsxv3.common.locking [None req-9e455680-6837-4025-aebe-79b7b497e11d None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=73002) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  793.852774] env[73002]: DEBUG oslo_concurrency.lockutils [None req-9e455680-6837-4025-aebe-79b7b497e11d None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73002) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  793.852898] env[73002]: DEBUG oslo_concurrency.lockutils [None req-9e455680-6837-4025-aebe-79b7b497e11d None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73002) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  793.853273] env[73002]: DEBUG oslo_concurrency.lockutils [None req-9e455680-6837-4025-aebe-79b7b497e11d None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73002) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  793.862602] env[73002]: DEBUG oslo_concurrency.lockutils [None req-9e455680-6837-4025-aebe-79b7b497e11d None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73002) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  793.862860] env[73002]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-9e455680-6837-4025-aebe-79b7b497e11d None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  793.863001] env[73002]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-9e455680-6837-4025-aebe-79b7b497e11d None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=73002) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  795.871441] env[73002]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-9e455680-6837-4025-aebe-79b7b497e11d None None] Session token - acquiring
[  795.871441] env[73002]: DEBUG networking_nsxv3.common.locking [None req-9e455680-6837-4025-aebe-79b7b497e11d None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=73002) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  795.871441] env[73002]: DEBUG oslo_concurrency.lockutils [None req-9e455680-6837-4025-aebe-79b7b497e11d None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73002) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  795.871891] env[73002]: DEBUG oslo_concurrency.lockutils [None req-9e455680-6837-4025-aebe-79b7b497e11d None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73002) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  795.871891] env[73002]: DEBUG oslo_concurrency.lockutils [None req-9e455680-6837-4025-aebe-79b7b497e11d None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73002) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  795.879728] env[73002]: DEBUG oslo_concurrency.lockutils [None req-9e455680-6837-4025-aebe-79b7b497e11d None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73002) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  795.880234] env[73002]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-9e455680-6837-4025-aebe-79b7b497e11d None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  795.880520] env[73002]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-9e455680-6837-4025-aebe-79b7b497e11d None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=73002) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  797.883514] env[73002]: CRITICAL neutron [None req-9e455680-6837-4025-aebe-79b7b497e11d None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  797.883514] env[73002]: ERROR neutron Traceback (most recent call last):
[  797.883514] env[73002]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  797.883514] env[73002]: ERROR neutron     sys.exit(main())
[  797.883514] env[73002]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  797.883514] env[73002]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  797.883514] env[73002]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  797.883514] env[73002]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  797.883514] env[73002]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  797.883514] env[73002]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  797.883514] env[73002]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  797.883514] env[73002]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  797.883514] env[73002]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  797.883514] env[73002]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  797.883514] env[73002]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  797.883514] env[73002]: ERROR neutron     response = self.get(path=path, params=params)
[  797.884157] env[73002]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  797.884157] env[73002]: ERROR neutron     raise RuntimeError(msg, last_err)
[  797.884157] env[73002]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  797.884157] env[73002]: ERROR neutron 
[  800.447966] env[73258]: INFO neutron.common.config [-] Logging enabled!
[  800.448335] env[73258]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  800.448474] env[73258]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=73258) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  800.448698] env[73258]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  800.448791] env[73258]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  800.449641] env[73258]: WARNING oslo_policy.policy [None req-f2c4b6d9-773e-47a8-bb6e-7d34e4c86b9b None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  800.449861] env[73258]: WARNING oslo_policy.policy [None req-f2c4b6d9-773e-47a8-bb6e-7d34e4c86b9b None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  800.451134] env[73258]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-f2c4b6d9-773e-47a8-bb6e-7d34e4c86b9b None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  800.466295] env[73258]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f2c4b6d9-773e-47a8-bb6e-7d34e4c86b9b None None] Session token - acquiring
[  800.467261] env[73258]: DEBUG networking_nsxv3.common.locking [None req-f2c4b6d9-773e-47a8-bb6e-7d34e4c86b9b None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=73258) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  800.467496] env[73258]: DEBUG oslo_concurrency.lockutils [None req-f2c4b6d9-773e-47a8-bb6e-7d34e4c86b9b None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  800.467824] env[73258]: DEBUG oslo_concurrency.lockutils [None req-f2c4b6d9-773e-47a8-bb6e-7d34e4c86b9b None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  800.468350] env[73258]: DEBUG oslo_concurrency.lockutils [None req-f2c4b6d9-773e-47a8-bb6e-7d34e4c86b9b None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  800.478777] env[73258]: DEBUG oslo_concurrency.lockutils [None req-f2c4b6d9-773e-47a8-bb6e-7d34e4c86b9b None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  800.479082] env[73258]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f2c4b6d9-773e-47a8-bb6e-7d34e4c86b9b None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  800.479263] env[73258]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f2c4b6d9-773e-47a8-bb6e-7d34e4c86b9b None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=73258) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  802.485793] env[73258]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f2c4b6d9-773e-47a8-bb6e-7d34e4c86b9b None None] Session token - acquiring
[  802.486628] env[73258]: DEBUG networking_nsxv3.common.locking [None req-f2c4b6d9-773e-47a8-bb6e-7d34e4c86b9b None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=73258) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  802.486628] env[73258]: DEBUG oslo_concurrency.lockutils [None req-f2c4b6d9-773e-47a8-bb6e-7d34e4c86b9b None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  802.486754] env[73258]: DEBUG oslo_concurrency.lockutils [None req-f2c4b6d9-773e-47a8-bb6e-7d34e4c86b9b None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  802.486997] env[73258]: DEBUG oslo_concurrency.lockutils [None req-f2c4b6d9-773e-47a8-bb6e-7d34e4c86b9b None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  802.497968] env[73258]: DEBUG oslo_concurrency.lockutils [None req-f2c4b6d9-773e-47a8-bb6e-7d34e4c86b9b None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  802.498267] env[73258]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f2c4b6d9-773e-47a8-bb6e-7d34e4c86b9b None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  802.498449] env[73258]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f2c4b6d9-773e-47a8-bb6e-7d34e4c86b9b None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=73258) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  804.501015] env[73258]: CRITICAL neutron [None req-f2c4b6d9-773e-47a8-bb6e-7d34e4c86b9b None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  804.501015] env[73258]: ERROR neutron Traceback (most recent call last):
[  804.501015] env[73258]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  804.501015] env[73258]: ERROR neutron     sys.exit(main())
[  804.501015] env[73258]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  804.501015] env[73258]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  804.501015] env[73258]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  804.501015] env[73258]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  804.501015] env[73258]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  804.501015] env[73258]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  804.501015] env[73258]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  804.501015] env[73258]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  804.501015] env[73258]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  804.501015] env[73258]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  804.501015] env[73258]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  804.501015] env[73258]: ERROR neutron     response = self.get(path=path, params=params)
[  804.501631] env[73258]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  804.501631] env[73258]: ERROR neutron     raise RuntimeError(msg, last_err)
[  804.501631] env[73258]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  804.501631] env[73258]: ERROR neutron 
[  807.039180] env[73388]: INFO neutron.common.config [-] Logging enabled!
[  807.039180] env[73388]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  807.039180] env[73388]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=73388) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  807.039180] env[73388]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  807.039180] env[73388]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  807.039180] env[73388]: WARNING oslo_policy.policy [None req-d56ba90f-9b94-4e3c-af52-72543b371d1f None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  807.039180] env[73388]: WARNING oslo_policy.policy [None req-d56ba90f-9b94-4e3c-af52-72543b371d1f None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  807.039180] env[73388]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-d56ba90f-9b94-4e3c-af52-72543b371d1f None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  807.051367] env[73388]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-d56ba90f-9b94-4e3c-af52-72543b371d1f None None] Session token - acquiring
[  807.052299] env[73388]: DEBUG networking_nsxv3.common.locking [None req-d56ba90f-9b94-4e3c-af52-72543b371d1f None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=73388) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  807.052563] env[73388]: DEBUG oslo_concurrency.lockutils [None req-d56ba90f-9b94-4e3c-af52-72543b371d1f None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73388) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  807.052728] env[73388]: DEBUG oslo_concurrency.lockutils [None req-d56ba90f-9b94-4e3c-af52-72543b371d1f None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73388) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  807.053132] env[73388]: DEBUG oslo_concurrency.lockutils [None req-d56ba90f-9b94-4e3c-af52-72543b371d1f None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73388) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  807.063452] env[73388]: DEBUG oslo_concurrency.lockutils [None req-d56ba90f-9b94-4e3c-af52-72543b371d1f None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73388) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  807.063773] env[73388]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-d56ba90f-9b94-4e3c-af52-72543b371d1f None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  807.063962] env[73388]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-d56ba90f-9b94-4e3c-af52-72543b371d1f None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=73388) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  809.070333] env[73388]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-d56ba90f-9b94-4e3c-af52-72543b371d1f None None] Session token - acquiring
[  809.070627] env[73388]: DEBUG networking_nsxv3.common.locking [None req-d56ba90f-9b94-4e3c-af52-72543b371d1f None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=73388) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  809.070903] env[73388]: DEBUG oslo_concurrency.lockutils [None req-d56ba90f-9b94-4e3c-af52-72543b371d1f None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73388) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  809.070958] env[73388]: DEBUG oslo_concurrency.lockutils [None req-d56ba90f-9b94-4e3c-af52-72543b371d1f None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73388) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  809.071241] env[73388]: DEBUG oslo_concurrency.lockutils [None req-d56ba90f-9b94-4e3c-af52-72543b371d1f None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73388) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  809.080219] env[73388]: DEBUG oslo_concurrency.lockutils [None req-d56ba90f-9b94-4e3c-af52-72543b371d1f None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73388) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  809.080462] env[73388]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-d56ba90f-9b94-4e3c-af52-72543b371d1f None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  809.080601] env[73388]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-d56ba90f-9b94-4e3c-af52-72543b371d1f None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=73388) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  811.083803] env[73388]: CRITICAL neutron [None req-d56ba90f-9b94-4e3c-af52-72543b371d1f None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  811.083803] env[73388]: ERROR neutron Traceback (most recent call last):
[  811.083803] env[73388]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  811.083803] env[73388]: ERROR neutron     sys.exit(main())
[  811.083803] env[73388]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  811.083803] env[73388]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  811.083803] env[73388]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  811.083803] env[73388]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  811.083803] env[73388]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  811.083803] env[73388]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  811.083803] env[73388]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  811.083803] env[73388]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  811.083803] env[73388]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  811.083803] env[73388]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  811.083803] env[73388]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  811.083803] env[73388]: ERROR neutron     response = self.get(path=path, params=params)
[  811.085050] env[73388]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  811.085050] env[73388]: ERROR neutron     raise RuntimeError(msg, last_err)
[  811.085050] env[73388]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  811.085050] env[73388]: ERROR neutron 
[  813.678918] env[73508]: INFO neutron.common.config [-] Logging enabled!
[  813.679159] env[73508]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  813.679571] env[73508]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=73508) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  813.679845] env[73508]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  813.680096] env[73508]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  813.681184] env[73508]: WARNING oslo_policy.policy [None req-3f9393ee-884a-4441-a9bf-a227ff534f4d None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  813.681415] env[73508]: WARNING oslo_policy.policy [None req-3f9393ee-884a-4441-a9bf-a227ff534f4d None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  813.682715] env[73508]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-3f9393ee-884a-4441-a9bf-a227ff534f4d None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  813.702876] env[73508]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3f9393ee-884a-4441-a9bf-a227ff534f4d None None] Session token - acquiring
[  813.703735] env[73508]: DEBUG networking_nsxv3.common.locking [None req-3f9393ee-884a-4441-a9bf-a227ff534f4d None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=73508) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  813.703966] env[73508]: DEBUG oslo_concurrency.lockutils [None req-3f9393ee-884a-4441-a9bf-a227ff534f4d None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73508) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  813.704116] env[73508]: DEBUG oslo_concurrency.lockutils [None req-3f9393ee-884a-4441-a9bf-a227ff534f4d None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73508) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  813.704490] env[73508]: DEBUG oslo_concurrency.lockutils [None req-3f9393ee-884a-4441-a9bf-a227ff534f4d None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73508) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  813.722531] env[73508]: DEBUG oslo_concurrency.lockutils [None req-3f9393ee-884a-4441-a9bf-a227ff534f4d None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73508) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  813.725022] env[73508]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3f9393ee-884a-4441-a9bf-a227ff534f4d None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  813.725206] env[73508]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3f9393ee-884a-4441-a9bf-a227ff534f4d None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=73508) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  815.731800] env[73508]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3f9393ee-884a-4441-a9bf-a227ff534f4d None None] Session token - acquiring
[  815.732222] env[73508]: DEBUG networking_nsxv3.common.locking [None req-3f9393ee-884a-4441-a9bf-a227ff534f4d None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=73508) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  815.732439] env[73508]: DEBUG oslo_concurrency.lockutils [None req-3f9393ee-884a-4441-a9bf-a227ff534f4d None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73508) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  815.732574] env[73508]: DEBUG oslo_concurrency.lockutils [None req-3f9393ee-884a-4441-a9bf-a227ff534f4d None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73508) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  815.732870] env[73508]: DEBUG oslo_concurrency.lockutils [None req-3f9393ee-884a-4441-a9bf-a227ff534f4d None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73508) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  815.744712] env[73508]: DEBUG oslo_concurrency.lockutils [None req-3f9393ee-884a-4441-a9bf-a227ff534f4d None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73508) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  815.744974] env[73508]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3f9393ee-884a-4441-a9bf-a227ff534f4d None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  815.745111] env[73508]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3f9393ee-884a-4441-a9bf-a227ff534f4d None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=73508) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  817.747762] env[73508]: CRITICAL neutron [None req-3f9393ee-884a-4441-a9bf-a227ff534f4d None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  817.747762] env[73508]: ERROR neutron Traceback (most recent call last):
[  817.747762] env[73508]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  817.747762] env[73508]: ERROR neutron     sys.exit(main())
[  817.747762] env[73508]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  817.747762] env[73508]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  817.747762] env[73508]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  817.747762] env[73508]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  817.747762] env[73508]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  817.747762] env[73508]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  817.747762] env[73508]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  817.747762] env[73508]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  817.747762] env[73508]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  817.747762] env[73508]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  817.747762] env[73508]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  817.747762] env[73508]: ERROR neutron     response = self.get(path=path, params=params)
[  817.748447] env[73508]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  817.748447] env[73508]: ERROR neutron     raise RuntimeError(msg, last_err)
[  817.748447] env[73508]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  817.748447] env[73508]: ERROR neutron 
[  820.443919] env[73724]: INFO neutron.common.config [-] Logging enabled!
[  820.444288] env[73724]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  820.444465] env[73724]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=73724) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  820.444699] env[73724]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  820.444793] env[73724]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  820.445622] env[73724]: WARNING oslo_policy.policy [None req-ddd98241-a87a-460c-881f-38095b481903 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  820.445847] env[73724]: WARNING oslo_policy.policy [None req-ddd98241-a87a-460c-881f-38095b481903 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  820.447082] env[73724]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-ddd98241-a87a-460c-881f-38095b481903 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  820.461300] env[73724]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ddd98241-a87a-460c-881f-38095b481903 None None] Session token - acquiring
[  820.462119] env[73724]: DEBUG networking_nsxv3.common.locking [None req-ddd98241-a87a-460c-881f-38095b481903 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=73724) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  820.462404] env[73724]: DEBUG oslo_concurrency.lockutils [None req-ddd98241-a87a-460c-881f-38095b481903 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  820.462537] env[73724]: DEBUG oslo_concurrency.lockutils [None req-ddd98241-a87a-460c-881f-38095b481903 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  820.462926] env[73724]: DEBUG oslo_concurrency.lockutils [None req-ddd98241-a87a-460c-881f-38095b481903 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  820.473218] env[73724]: DEBUG oslo_concurrency.lockutils [None req-ddd98241-a87a-460c-881f-38095b481903 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  820.473473] env[73724]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ddd98241-a87a-460c-881f-38095b481903 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  820.473620] env[73724]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ddd98241-a87a-460c-881f-38095b481903 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=73724) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  822.481825] env[73724]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ddd98241-a87a-460c-881f-38095b481903 None None] Session token - acquiring
[  822.482307] env[73724]: DEBUG networking_nsxv3.common.locking [None req-ddd98241-a87a-460c-881f-38095b481903 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=73724) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  822.482455] env[73724]: DEBUG oslo_concurrency.lockutils [None req-ddd98241-a87a-460c-881f-38095b481903 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  822.482591] env[73724]: DEBUG oslo_concurrency.lockutils [None req-ddd98241-a87a-460c-881f-38095b481903 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  822.482863] env[73724]: DEBUG oslo_concurrency.lockutils [None req-ddd98241-a87a-460c-881f-38095b481903 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  822.492037] env[73724]: DEBUG oslo_concurrency.lockutils [None req-ddd98241-a87a-460c-881f-38095b481903 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  822.492530] env[73724]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ddd98241-a87a-460c-881f-38095b481903 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  822.492530] env[73724]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ddd98241-a87a-460c-881f-38095b481903 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=73724) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  824.495426] env[73724]: CRITICAL neutron [None req-ddd98241-a87a-460c-881f-38095b481903 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  824.495426] env[73724]: ERROR neutron Traceback (most recent call last):
[  824.495426] env[73724]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  824.495426] env[73724]: ERROR neutron     sys.exit(main())
[  824.495426] env[73724]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  824.495426] env[73724]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  824.495426] env[73724]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  824.495426] env[73724]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  824.495426] env[73724]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  824.495426] env[73724]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  824.495426] env[73724]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  824.495426] env[73724]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  824.495426] env[73724]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  824.495426] env[73724]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  824.495426] env[73724]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  824.495426] env[73724]: ERROR neutron     response = self.get(path=path, params=params)
[  824.496328] env[73724]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  824.496328] env[73724]: ERROR neutron     raise RuntimeError(msg, last_err)
[  824.496328] env[73724]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  824.496328] env[73724]: ERROR neutron 
[  827.215196] env[73835]: INFO neutron.common.config [-] Logging enabled!
[  827.215501] env[73835]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  827.215706] env[73835]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=73835) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  827.215934] env[73835]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  827.216081] env[73835]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  827.216915] env[73835]: WARNING oslo_policy.policy [None req-e5bbb701-a310-4af9-be0e-47b07cf9a5fa None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  827.217148] env[73835]: WARNING oslo_policy.policy [None req-e5bbb701-a310-4af9-be0e-47b07cf9a5fa None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  827.218307] env[73835]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-e5bbb701-a310-4af9-be0e-47b07cf9a5fa None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  827.232102] env[73835]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e5bbb701-a310-4af9-be0e-47b07cf9a5fa None None] Session token - acquiring
[  827.232896] env[73835]: DEBUG networking_nsxv3.common.locking [None req-e5bbb701-a310-4af9-be0e-47b07cf9a5fa None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=73835) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  827.233088] env[73835]: DEBUG oslo_concurrency.lockutils [None req-e5bbb701-a310-4af9-be0e-47b07cf9a5fa None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73835) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  827.233220] env[73835]: DEBUG oslo_concurrency.lockutils [None req-e5bbb701-a310-4af9-be0e-47b07cf9a5fa None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73835) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  827.233586] env[73835]: DEBUG oslo_concurrency.lockutils [None req-e5bbb701-a310-4af9-be0e-47b07cf9a5fa None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73835) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  827.243273] env[73835]: DEBUG oslo_concurrency.lockutils [None req-e5bbb701-a310-4af9-be0e-47b07cf9a5fa None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73835) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  827.243517] env[73835]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e5bbb701-a310-4af9-be0e-47b07cf9a5fa None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  827.243672] env[73835]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e5bbb701-a310-4af9-be0e-47b07cf9a5fa None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=73835) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  829.249777] env[73835]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e5bbb701-a310-4af9-be0e-47b07cf9a5fa None None] Session token - acquiring
[  829.250138] env[73835]: DEBUG networking_nsxv3.common.locking [None req-e5bbb701-a310-4af9-be0e-47b07cf9a5fa None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=73835) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  829.250323] env[73835]: DEBUG oslo_concurrency.lockutils [None req-e5bbb701-a310-4af9-be0e-47b07cf9a5fa None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73835) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  829.250489] env[73835]: DEBUG oslo_concurrency.lockutils [None req-e5bbb701-a310-4af9-be0e-47b07cf9a5fa None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73835) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  829.250789] env[73835]: DEBUG oslo_concurrency.lockutils [None req-e5bbb701-a310-4af9-be0e-47b07cf9a5fa None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73835) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  829.260154] env[73835]: DEBUG oslo_concurrency.lockutils [None req-e5bbb701-a310-4af9-be0e-47b07cf9a5fa None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73835) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  829.260401] env[73835]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e5bbb701-a310-4af9-be0e-47b07cf9a5fa None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  829.260545] env[73835]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e5bbb701-a310-4af9-be0e-47b07cf9a5fa None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=73835) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  831.261739] env[73835]: CRITICAL neutron [None req-e5bbb701-a310-4af9-be0e-47b07cf9a5fa None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  831.261739] env[73835]: ERROR neutron Traceback (most recent call last):
[  831.261739] env[73835]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  831.261739] env[73835]: ERROR neutron     sys.exit(main())
[  831.261739] env[73835]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  831.261739] env[73835]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  831.261739] env[73835]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  831.261739] env[73835]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  831.261739] env[73835]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  831.261739] env[73835]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  831.261739] env[73835]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  831.261739] env[73835]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  831.261739] env[73835]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  831.261739] env[73835]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  831.261739] env[73835]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  831.261739] env[73835]: ERROR neutron     response = self.get(path=path, params=params)
[  831.262370] env[73835]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  831.262370] env[73835]: ERROR neutron     raise RuntimeError(msg, last_err)
[  831.262370] env[73835]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  831.262370] env[73835]: ERROR neutron 
[  833.933345] env[73878]: INFO neutron.common.config [-] Logging enabled!
[  833.933793] env[73878]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  833.933873] env[73878]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=73878) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  833.934086] env[73878]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  833.934179] env[73878]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  833.935020] env[73878]: WARNING oslo_policy.policy [None req-7d398e30-b11c-4e9e-9407-f894ef025e9b None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  833.935241] env[73878]: WARNING oslo_policy.policy [None req-7d398e30-b11c-4e9e-9407-f894ef025e9b None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  833.936464] env[73878]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-7d398e30-b11c-4e9e-9407-f894ef025e9b None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  833.950935] env[73878]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-7d398e30-b11c-4e9e-9407-f894ef025e9b None None] Session token - acquiring
[  833.951760] env[73878]: DEBUG networking_nsxv3.common.locking [None req-7d398e30-b11c-4e9e-9407-f894ef025e9b None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=73878) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  833.952246] env[73878]: DEBUG oslo_concurrency.lockutils [None req-7d398e30-b11c-4e9e-9407-f894ef025e9b None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73878) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  833.952246] env[73878]: DEBUG oslo_concurrency.lockutils [None req-7d398e30-b11c-4e9e-9407-f894ef025e9b None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73878) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  833.952506] env[73878]: DEBUG oslo_concurrency.lockutils [None req-7d398e30-b11c-4e9e-9407-f894ef025e9b None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73878) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  833.962142] env[73878]: DEBUG oslo_concurrency.lockutils [None req-7d398e30-b11c-4e9e-9407-f894ef025e9b None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73878) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  833.962398] env[73878]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-7d398e30-b11c-4e9e-9407-f894ef025e9b None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  833.962577] env[73878]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-7d398e30-b11c-4e9e-9407-f894ef025e9b None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=73878) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  835.968886] env[73878]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-7d398e30-b11c-4e9e-9407-f894ef025e9b None None] Session token - acquiring
[  835.969238] env[73878]: DEBUG networking_nsxv3.common.locking [None req-7d398e30-b11c-4e9e-9407-f894ef025e9b None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=73878) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  835.969362] env[73878]: DEBUG oslo_concurrency.lockutils [None req-7d398e30-b11c-4e9e-9407-f894ef025e9b None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73878) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  835.969550] env[73878]: DEBUG oslo_concurrency.lockutils [None req-7d398e30-b11c-4e9e-9407-f894ef025e9b None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73878) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  835.970570] env[73878]: DEBUG oslo_concurrency.lockutils [None req-7d398e30-b11c-4e9e-9407-f894ef025e9b None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73878) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  835.979237] env[73878]: DEBUG oslo_concurrency.lockutils [None req-7d398e30-b11c-4e9e-9407-f894ef025e9b None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73878) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  835.979415] env[73878]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-7d398e30-b11c-4e9e-9407-f894ef025e9b None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  835.979551] env[73878]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-7d398e30-b11c-4e9e-9407-f894ef025e9b None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=73878) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  837.982992] env[73878]: CRITICAL neutron [None req-7d398e30-b11c-4e9e-9407-f894ef025e9b None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  837.982992] env[73878]: ERROR neutron Traceback (most recent call last):
[  837.982992] env[73878]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  837.982992] env[73878]: ERROR neutron     sys.exit(main())
[  837.982992] env[73878]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  837.982992] env[73878]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  837.982992] env[73878]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  837.982992] env[73878]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  837.982992] env[73878]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  837.982992] env[73878]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  837.982992] env[73878]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  837.982992] env[73878]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  837.982992] env[73878]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  837.982992] env[73878]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  837.982992] env[73878]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  837.982992] env[73878]: ERROR neutron     response = self.get(path=path, params=params)
[  837.983714] env[73878]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  837.983714] env[73878]: ERROR neutron     raise RuntimeError(msg, last_err)
[  837.983714] env[73878]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  837.983714] env[73878]: ERROR neutron 
[  840.612478] env[74153]: INFO neutron.common.config [-] Logging enabled!
[  840.612478] env[74153]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  840.612478] env[74153]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=74153) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  840.612478] env[74153]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  840.612798] env[74153]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  840.613441] env[74153]: WARNING oslo_policy.policy [None req-ce6cd741-24f4-4042-886b-e9e6dd9bb905 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  840.613647] env[74153]: WARNING oslo_policy.policy [None req-ce6cd741-24f4-4042-886b-e9e6dd9bb905 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  840.614865] env[74153]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-ce6cd741-24f4-4042-886b-e9e6dd9bb905 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  840.634546] env[74153]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ce6cd741-24f4-4042-886b-e9e6dd9bb905 None None] Session token - acquiring
[  840.635114] env[74153]: DEBUG networking_nsxv3.common.locking [None req-ce6cd741-24f4-4042-886b-e9e6dd9bb905 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=74153) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  840.639001] env[74153]: DEBUG oslo_concurrency.lockutils [None req-ce6cd741-24f4-4042-886b-e9e6dd9bb905 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74153) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  840.639001] env[74153]: DEBUG oslo_concurrency.lockutils [None req-ce6cd741-24f4-4042-886b-e9e6dd9bb905 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74153) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  840.639001] env[74153]: DEBUG oslo_concurrency.lockutils [None req-ce6cd741-24f4-4042-886b-e9e6dd9bb905 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74153) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  840.648113] env[74153]: DEBUG oslo_concurrency.lockutils [None req-ce6cd741-24f4-4042-886b-e9e6dd9bb905 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74153) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  840.651522] env[74153]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ce6cd741-24f4-4042-886b-e9e6dd9bb905 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  840.651775] env[74153]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ce6cd741-24f4-4042-886b-e9e6dd9bb905 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=74153) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  842.658081] env[74153]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ce6cd741-24f4-4042-886b-e9e6dd9bb905 None None] Session token - acquiring
[  842.658081] env[74153]: DEBUG networking_nsxv3.common.locking [None req-ce6cd741-24f4-4042-886b-e9e6dd9bb905 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=74153) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  842.658081] env[74153]: DEBUG oslo_concurrency.lockutils [None req-ce6cd741-24f4-4042-886b-e9e6dd9bb905 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74153) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  842.658409] env[74153]: DEBUG oslo_concurrency.lockutils [None req-ce6cd741-24f4-4042-886b-e9e6dd9bb905 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74153) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  842.658409] env[74153]: DEBUG oslo_concurrency.lockutils [None req-ce6cd741-24f4-4042-886b-e9e6dd9bb905 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74153) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  842.668057] env[74153]: DEBUG oslo_concurrency.lockutils [None req-ce6cd741-24f4-4042-886b-e9e6dd9bb905 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74153) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  842.668318] env[74153]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ce6cd741-24f4-4042-886b-e9e6dd9bb905 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  842.669127] env[74153]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ce6cd741-24f4-4042-886b-e9e6dd9bb905 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=74153) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  844.672330] env[74153]: CRITICAL neutron [None req-ce6cd741-24f4-4042-886b-e9e6dd9bb905 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  844.672330] env[74153]: ERROR neutron Traceback (most recent call last):
[  844.672330] env[74153]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  844.672330] env[74153]: ERROR neutron     sys.exit(main())
[  844.672330] env[74153]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  844.672330] env[74153]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  844.672330] env[74153]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  844.672330] env[74153]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  844.672330] env[74153]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  844.672330] env[74153]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  844.672330] env[74153]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  844.672330] env[74153]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  844.672330] env[74153]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  844.672330] env[74153]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  844.672330] env[74153]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  844.672330] env[74153]: ERROR neutron     response = self.get(path=path, params=params)
[  844.673072] env[74153]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  844.673072] env[74153]: ERROR neutron     raise RuntimeError(msg, last_err)
[  844.673072] env[74153]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  844.673072] env[74153]: ERROR neutron 
[  847.473322] env[74361]: INFO neutron.common.config [-] Logging enabled!
[  847.473614] env[74361]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  847.473847] env[74361]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=74361) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  847.474071] env[74361]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  847.474160] env[74361]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  847.475021] env[74361]: WARNING oslo_policy.policy [None req-106d68df-e066-4349-89c8-6a2beff8bf1e None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  847.475247] env[74361]: WARNING oslo_policy.policy [None req-106d68df-e066-4349-89c8-6a2beff8bf1e None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  847.476471] env[74361]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-106d68df-e066-4349-89c8-6a2beff8bf1e None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  847.490430] env[74361]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-106d68df-e066-4349-89c8-6a2beff8bf1e None None] Session token - acquiring
[  847.491263] env[74361]: DEBUG networking_nsxv3.common.locking [None req-106d68df-e066-4349-89c8-6a2beff8bf1e None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=74361) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  847.491460] env[74361]: DEBUG oslo_concurrency.lockutils [None req-106d68df-e066-4349-89c8-6a2beff8bf1e None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74361) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  847.491584] env[74361]: DEBUG oslo_concurrency.lockutils [None req-106d68df-e066-4349-89c8-6a2beff8bf1e None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74361) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  847.491946] env[74361]: DEBUG oslo_concurrency.lockutils [None req-106d68df-e066-4349-89c8-6a2beff8bf1e None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74361) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  847.505139] env[74361]: DEBUG oslo_concurrency.lockutils [None req-106d68df-e066-4349-89c8-6a2beff8bf1e None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74361) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  847.505365] env[74361]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-106d68df-e066-4349-89c8-6a2beff8bf1e None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  847.505708] env[74361]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-106d68df-e066-4349-89c8-6a2beff8bf1e None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=74361) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  849.517046] env[74361]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-106d68df-e066-4349-89c8-6a2beff8bf1e None None] Session token - acquiring
[  849.517517] env[74361]: DEBUG networking_nsxv3.common.locking [None req-106d68df-e066-4349-89c8-6a2beff8bf1e None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=74361) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  849.517712] env[74361]: DEBUG oslo_concurrency.lockutils [None req-106d68df-e066-4349-89c8-6a2beff8bf1e None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74361) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  849.517859] env[74361]: DEBUG oslo_concurrency.lockutils [None req-106d68df-e066-4349-89c8-6a2beff8bf1e None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74361) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  849.518143] env[74361]: DEBUG oslo_concurrency.lockutils [None req-106d68df-e066-4349-89c8-6a2beff8bf1e None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74361) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  849.532406] env[74361]: DEBUG oslo_concurrency.lockutils [None req-106d68df-e066-4349-89c8-6a2beff8bf1e None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74361) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  849.532700] env[74361]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-106d68df-e066-4349-89c8-6a2beff8bf1e None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  849.532809] env[74361]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-106d68df-e066-4349-89c8-6a2beff8bf1e None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=74361) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  851.535732] env[74361]: CRITICAL neutron [None req-106d68df-e066-4349-89c8-6a2beff8bf1e None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  851.535732] env[74361]: ERROR neutron Traceback (most recent call last):
[  851.535732] env[74361]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  851.535732] env[74361]: ERROR neutron     sys.exit(main())
[  851.535732] env[74361]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  851.535732] env[74361]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  851.535732] env[74361]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  851.535732] env[74361]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  851.535732] env[74361]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  851.535732] env[74361]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  851.535732] env[74361]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  851.535732] env[74361]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  851.535732] env[74361]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  851.535732] env[74361]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  851.535732] env[74361]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  851.535732] env[74361]: ERROR neutron     response = self.get(path=path, params=params)
[  851.536473] env[74361]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  851.536473] env[74361]: ERROR neutron     raise RuntimeError(msg, last_err)
[  851.536473] env[74361]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  851.536473] env[74361]: ERROR neutron 
[  854.346634] env[74479]: INFO neutron.common.config [-] Logging enabled!
[  854.346854] env[74479]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  854.347195] env[74479]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=74479) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  854.347448] env[74479]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  854.347546] env[74479]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  854.348648] env[74479]: WARNING oslo_policy.policy [None req-5f5c3148-5c8e-4f73-b503-abcc97627e66 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  854.348897] env[74479]: WARNING oslo_policy.policy [None req-5f5c3148-5c8e-4f73-b503-abcc97627e66 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  854.350314] env[74479]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-5f5c3148-5c8e-4f73-b503-abcc97627e66 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  854.364282] env[74479]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5f5c3148-5c8e-4f73-b503-abcc97627e66 None None] Session token - acquiring
[  854.365184] env[74479]: DEBUG networking_nsxv3.common.locking [None req-5f5c3148-5c8e-4f73-b503-abcc97627e66 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=74479) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  854.365288] env[74479]: DEBUG oslo_concurrency.lockutils [None req-5f5c3148-5c8e-4f73-b503-abcc97627e66 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74479) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  854.365416] env[74479]: DEBUG oslo_concurrency.lockutils [None req-5f5c3148-5c8e-4f73-b503-abcc97627e66 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74479) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  854.365786] env[74479]: DEBUG oslo_concurrency.lockutils [None req-5f5c3148-5c8e-4f73-b503-abcc97627e66 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74479) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  854.374966] env[74479]: DEBUG oslo_concurrency.lockutils [None req-5f5c3148-5c8e-4f73-b503-abcc97627e66 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74479) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  854.375225] env[74479]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5f5c3148-5c8e-4f73-b503-abcc97627e66 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  854.375387] env[74479]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5f5c3148-5c8e-4f73-b503-abcc97627e66 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=74479) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  856.381453] env[74479]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5f5c3148-5c8e-4f73-b503-abcc97627e66 None None] Session token - acquiring
[  856.382098] env[74479]: DEBUG networking_nsxv3.common.locking [None req-5f5c3148-5c8e-4f73-b503-abcc97627e66 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=74479) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  856.382306] env[74479]: DEBUG oslo_concurrency.lockutils [None req-5f5c3148-5c8e-4f73-b503-abcc97627e66 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74479) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  856.382433] env[74479]: DEBUG oslo_concurrency.lockutils [None req-5f5c3148-5c8e-4f73-b503-abcc97627e66 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74479) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  856.382706] env[74479]: DEBUG oslo_concurrency.lockutils [None req-5f5c3148-5c8e-4f73-b503-abcc97627e66 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74479) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  856.392287] env[74479]: DEBUG oslo_concurrency.lockutils [None req-5f5c3148-5c8e-4f73-b503-abcc97627e66 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74479) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  856.392545] env[74479]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5f5c3148-5c8e-4f73-b503-abcc97627e66 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  856.392685] env[74479]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5f5c3148-5c8e-4f73-b503-abcc97627e66 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=74479) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  858.395688] env[74479]: CRITICAL neutron [None req-5f5c3148-5c8e-4f73-b503-abcc97627e66 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  858.395688] env[74479]: ERROR neutron Traceback (most recent call last):
[  858.395688] env[74479]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  858.395688] env[74479]: ERROR neutron     sys.exit(main())
[  858.395688] env[74479]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  858.395688] env[74479]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  858.395688] env[74479]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  858.395688] env[74479]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  858.395688] env[74479]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  858.395688] env[74479]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  858.395688] env[74479]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  858.395688] env[74479]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  858.395688] env[74479]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  858.395688] env[74479]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  858.395688] env[74479]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  858.395688] env[74479]: ERROR neutron     response = self.get(path=path, params=params)
[  858.396321] env[74479]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  858.396321] env[74479]: ERROR neutron     raise RuntimeError(msg, last_err)
[  858.396321] env[74479]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  858.396321] env[74479]: ERROR neutron 
[  861.035726] env[74978]: INFO neutron.common.config [-] Logging enabled!
[  861.036024] env[74978]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  861.036286] env[74978]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=74978) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  861.036493] env[74978]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  861.036581] env[74978]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  861.037428] env[74978]: WARNING oslo_policy.policy [None req-1a077203-750a-46f6-be3b-257312369ffa None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  861.037687] env[74978]: WARNING oslo_policy.policy [None req-1a077203-750a-46f6-be3b-257312369ffa None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  861.038836] env[74978]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-1a077203-750a-46f6-be3b-257312369ffa None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  861.053515] env[74978]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-1a077203-750a-46f6-be3b-257312369ffa None None] Session token - acquiring
[  861.054322] env[74978]: DEBUG networking_nsxv3.common.locking [None req-1a077203-750a-46f6-be3b-257312369ffa None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=74978) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  861.054522] env[74978]: DEBUG oslo_concurrency.lockutils [None req-1a077203-750a-46f6-be3b-257312369ffa None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74978) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  861.054642] env[74978]: DEBUG oslo_concurrency.lockutils [None req-1a077203-750a-46f6-be3b-257312369ffa None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74978) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  861.055005] env[74978]: DEBUG oslo_concurrency.lockutils [None req-1a077203-750a-46f6-be3b-257312369ffa None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74978) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  861.064330] env[74978]: DEBUG oslo_concurrency.lockutils [None req-1a077203-750a-46f6-be3b-257312369ffa None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74978) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  861.064536] env[74978]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-1a077203-750a-46f6-be3b-257312369ffa None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  861.064682] env[74978]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-1a077203-750a-46f6-be3b-257312369ffa None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=74978) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  863.070694] env[74978]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-1a077203-750a-46f6-be3b-257312369ffa None None] Session token - acquiring
[  863.071088] env[74978]: DEBUG networking_nsxv3.common.locking [None req-1a077203-750a-46f6-be3b-257312369ffa None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=74978) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  863.071288] env[74978]: DEBUG oslo_concurrency.lockutils [None req-1a077203-750a-46f6-be3b-257312369ffa None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74978) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  863.071415] env[74978]: DEBUG oslo_concurrency.lockutils [None req-1a077203-750a-46f6-be3b-257312369ffa None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74978) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  863.071811] env[74978]: DEBUG oslo_concurrency.lockutils [None req-1a077203-750a-46f6-be3b-257312369ffa None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74978) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  863.080687] env[74978]: DEBUG oslo_concurrency.lockutils [None req-1a077203-750a-46f6-be3b-257312369ffa None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74978) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  863.080912] env[74978]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-1a077203-750a-46f6-be3b-257312369ffa None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  863.081106] env[74978]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-1a077203-750a-46f6-be3b-257312369ffa None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=74978) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  865.094820] env[74978]: CRITICAL neutron [None req-1a077203-750a-46f6-be3b-257312369ffa None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  865.094820] env[74978]: ERROR neutron Traceback (most recent call last):
[  865.094820] env[74978]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  865.094820] env[74978]: ERROR neutron     sys.exit(main())
[  865.094820] env[74978]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  865.094820] env[74978]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  865.094820] env[74978]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  865.094820] env[74978]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  865.094820] env[74978]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  865.094820] env[74978]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  865.094820] env[74978]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  865.094820] env[74978]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  865.094820] env[74978]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  865.094820] env[74978]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  865.094820] env[74978]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  865.094820] env[74978]: ERROR neutron     response = self.get(path=path, params=params)
[  865.095599] env[74978]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  865.095599] env[74978]: ERROR neutron     raise RuntimeError(msg, last_err)
[  865.095599] env[74978]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  865.095599] env[74978]: ERROR neutron 
[  867.703266] env[75160]: INFO neutron.common.config [-] Logging enabled!
[  867.703592] env[75160]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  867.703767] env[75160]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=75160) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  867.703981] env[75160]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  867.704113] env[75160]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  867.704953] env[75160]: WARNING oslo_policy.policy [None req-987d9df6-fdd5-4585-aa5e-cad9b5d3979b None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  867.705178] env[75160]: WARNING oslo_policy.policy [None req-987d9df6-fdd5-4585-aa5e-cad9b5d3979b None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  867.706325] env[75160]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-987d9df6-fdd5-4585-aa5e-cad9b5d3979b None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  867.721003] env[75160]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-987d9df6-fdd5-4585-aa5e-cad9b5d3979b None None] Session token - acquiring
[  867.721884] env[75160]: DEBUG networking_nsxv3.common.locking [None req-987d9df6-fdd5-4585-aa5e-cad9b5d3979b None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=75160) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  867.722223] env[75160]: DEBUG oslo_concurrency.lockutils [None req-987d9df6-fdd5-4585-aa5e-cad9b5d3979b None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75160) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  867.722449] env[75160]: DEBUG oslo_concurrency.lockutils [None req-987d9df6-fdd5-4585-aa5e-cad9b5d3979b None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75160) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  867.722882] env[75160]: DEBUG oslo_concurrency.lockutils [None req-987d9df6-fdd5-4585-aa5e-cad9b5d3979b None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75160) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  867.732134] env[75160]: DEBUG oslo_concurrency.lockutils [None req-987d9df6-fdd5-4585-aa5e-cad9b5d3979b None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75160) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  867.732505] env[75160]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-987d9df6-fdd5-4585-aa5e-cad9b5d3979b None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  867.732751] env[75160]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-987d9df6-fdd5-4585-aa5e-cad9b5d3979b None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=75160) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  869.738830] env[75160]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-987d9df6-fdd5-4585-aa5e-cad9b5d3979b None None] Session token - acquiring
[  869.739302] env[75160]: DEBUG networking_nsxv3.common.locking [None req-987d9df6-fdd5-4585-aa5e-cad9b5d3979b None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=75160) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  869.739433] env[75160]: DEBUG oslo_concurrency.lockutils [None req-987d9df6-fdd5-4585-aa5e-cad9b5d3979b None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75160) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  869.739560] env[75160]: DEBUG oslo_concurrency.lockutils [None req-987d9df6-fdd5-4585-aa5e-cad9b5d3979b None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75160) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  869.739823] env[75160]: DEBUG oslo_concurrency.lockutils [None req-987d9df6-fdd5-4585-aa5e-cad9b5d3979b None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75160) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  869.748788] env[75160]: DEBUG oslo_concurrency.lockutils [None req-987d9df6-fdd5-4585-aa5e-cad9b5d3979b None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75160) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  869.749015] env[75160]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-987d9df6-fdd5-4585-aa5e-cad9b5d3979b None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  869.749157] env[75160]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-987d9df6-fdd5-4585-aa5e-cad9b5d3979b None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=75160) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  871.752072] env[75160]: CRITICAL neutron [None req-987d9df6-fdd5-4585-aa5e-cad9b5d3979b None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  871.752072] env[75160]: ERROR neutron Traceback (most recent call last):
[  871.752072] env[75160]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  871.752072] env[75160]: ERROR neutron     sys.exit(main())
[  871.752072] env[75160]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  871.752072] env[75160]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  871.752072] env[75160]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  871.752072] env[75160]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  871.752072] env[75160]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  871.752072] env[75160]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  871.752072] env[75160]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  871.752072] env[75160]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  871.752072] env[75160]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  871.752072] env[75160]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  871.752072] env[75160]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  871.752072] env[75160]: ERROR neutron     response = self.get(path=path, params=params)
[  871.752761] env[75160]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  871.752761] env[75160]: ERROR neutron     raise RuntimeError(msg, last_err)
[  871.752761] env[75160]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  871.752761] env[75160]: ERROR neutron 
[  874.374177] env[75293]: INFO neutron.common.config [-] Logging enabled!
[  874.374526] env[75293]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  874.374735] env[75293]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=75293) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  874.374954] env[75293]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  874.375045] env[75293]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  874.375881] env[75293]: WARNING oslo_policy.policy [None req-4b6df513-e1b9-4119-ae56-19bceaaedf87 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  874.376127] env[75293]: WARNING oslo_policy.policy [None req-4b6df513-e1b9-4119-ae56-19bceaaedf87 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  874.377303] env[75293]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-4b6df513-e1b9-4119-ae56-19bceaaedf87 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  874.394492] env[75293]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-4b6df513-e1b9-4119-ae56-19bceaaedf87 None None] Session token - acquiring
[  874.395336] env[75293]: DEBUG networking_nsxv3.common.locking [None req-4b6df513-e1b9-4119-ae56-19bceaaedf87 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=75293) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  874.395568] env[75293]: DEBUG oslo_concurrency.lockutils [None req-4b6df513-e1b9-4119-ae56-19bceaaedf87 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  874.395697] env[75293]: DEBUG oslo_concurrency.lockutils [None req-4b6df513-e1b9-4119-ae56-19bceaaedf87 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  874.396082] env[75293]: DEBUG oslo_concurrency.lockutils [None req-4b6df513-e1b9-4119-ae56-19bceaaedf87 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  874.405439] env[75293]: DEBUG oslo_concurrency.lockutils [None req-4b6df513-e1b9-4119-ae56-19bceaaedf87 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  874.405699] env[75293]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-4b6df513-e1b9-4119-ae56-19bceaaedf87 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  874.405849] env[75293]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-4b6df513-e1b9-4119-ae56-19bceaaedf87 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=75293) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  876.413926] env[75293]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-4b6df513-e1b9-4119-ae56-19bceaaedf87 None None] Session token - acquiring
[  876.414220] env[75293]: DEBUG networking_nsxv3.common.locking [None req-4b6df513-e1b9-4119-ae56-19bceaaedf87 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=75293) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  876.414410] env[75293]: DEBUG oslo_concurrency.lockutils [None req-4b6df513-e1b9-4119-ae56-19bceaaedf87 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  876.414557] env[75293]: DEBUG oslo_concurrency.lockutils [None req-4b6df513-e1b9-4119-ae56-19bceaaedf87 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  876.414936] env[75293]: DEBUG oslo_concurrency.lockutils [None req-4b6df513-e1b9-4119-ae56-19bceaaedf87 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  876.423842] env[75293]: DEBUG oslo_concurrency.lockutils [None req-4b6df513-e1b9-4119-ae56-19bceaaedf87 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  876.424083] env[75293]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-4b6df513-e1b9-4119-ae56-19bceaaedf87 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  876.424229] env[75293]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-4b6df513-e1b9-4119-ae56-19bceaaedf87 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=75293) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  878.427194] env[75293]: CRITICAL neutron [None req-4b6df513-e1b9-4119-ae56-19bceaaedf87 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  878.427194] env[75293]: ERROR neutron Traceback (most recent call last):
[  878.427194] env[75293]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  878.427194] env[75293]: ERROR neutron     sys.exit(main())
[  878.427194] env[75293]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  878.427194] env[75293]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  878.427194] env[75293]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  878.427194] env[75293]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  878.427194] env[75293]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  878.427194] env[75293]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  878.427194] env[75293]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  878.427194] env[75293]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  878.427194] env[75293]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  878.427194] env[75293]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  878.427194] env[75293]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  878.427194] env[75293]: ERROR neutron     response = self.get(path=path, params=params)
[  878.427969] env[75293]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  878.427969] env[75293]: ERROR neutron     raise RuntimeError(msg, last_err)
[  878.427969] env[75293]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  878.427969] env[75293]: ERROR neutron 
[  880.938654] env[75346]: INFO neutron.common.config [-] Logging enabled!
[  880.938947] env[75346]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  880.939189] env[75346]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=75346) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  880.939451] env[75346]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  880.939524] env[75346]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  880.940411] env[75346]: WARNING oslo_policy.policy [None req-2ae3eff0-37b7-430d-bfc7-f93b5dc63e67 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  880.940635] env[75346]: WARNING oslo_policy.policy [None req-2ae3eff0-37b7-430d-bfc7-f93b5dc63e67 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  880.943710] env[75346]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-2ae3eff0-37b7-430d-bfc7-f93b5dc63e67 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  880.962475] env[75346]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-2ae3eff0-37b7-430d-bfc7-f93b5dc63e67 None None] Session token - acquiring
[  880.963318] env[75346]: DEBUG networking_nsxv3.common.locking [None req-2ae3eff0-37b7-430d-bfc7-f93b5dc63e67 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=75346) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  880.963530] env[75346]: DEBUG oslo_concurrency.lockutils [None req-2ae3eff0-37b7-430d-bfc7-f93b5dc63e67 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75346) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  880.964052] env[75346]: DEBUG oslo_concurrency.lockutils [None req-2ae3eff0-37b7-430d-bfc7-f93b5dc63e67 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75346) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  880.964052] env[75346]: DEBUG oslo_concurrency.lockutils [None req-2ae3eff0-37b7-430d-bfc7-f93b5dc63e67 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75346) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  880.973504] env[75346]: DEBUG oslo_concurrency.lockutils [None req-2ae3eff0-37b7-430d-bfc7-f93b5dc63e67 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75346) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  880.973770] env[75346]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-2ae3eff0-37b7-430d-bfc7-f93b5dc63e67 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  880.973929] env[75346]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-2ae3eff0-37b7-430d-bfc7-f93b5dc63e67 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=75346) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  882.980118] env[75346]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-2ae3eff0-37b7-430d-bfc7-f93b5dc63e67 None None] Session token - acquiring
[  882.980487] env[75346]: DEBUG networking_nsxv3.common.locking [None req-2ae3eff0-37b7-430d-bfc7-f93b5dc63e67 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=75346) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  882.980706] env[75346]: DEBUG oslo_concurrency.lockutils [None req-2ae3eff0-37b7-430d-bfc7-f93b5dc63e67 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75346) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  882.980838] env[75346]: DEBUG oslo_concurrency.lockutils [None req-2ae3eff0-37b7-430d-bfc7-f93b5dc63e67 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75346) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  882.981250] env[75346]: DEBUG oslo_concurrency.lockutils [None req-2ae3eff0-37b7-430d-bfc7-f93b5dc63e67 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75346) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  882.991209] env[75346]: DEBUG oslo_concurrency.lockutils [None req-2ae3eff0-37b7-430d-bfc7-f93b5dc63e67 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75346) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  882.991627] env[75346]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-2ae3eff0-37b7-430d-bfc7-f93b5dc63e67 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  882.991793] env[75346]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-2ae3eff0-37b7-430d-bfc7-f93b5dc63e67 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=75346) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  884.992949] env[75346]: CRITICAL neutron [None req-2ae3eff0-37b7-430d-bfc7-f93b5dc63e67 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  884.992949] env[75346]: ERROR neutron Traceback (most recent call last):
[  884.992949] env[75346]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  884.992949] env[75346]: ERROR neutron     sys.exit(main())
[  884.992949] env[75346]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  884.992949] env[75346]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  884.992949] env[75346]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  884.992949] env[75346]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  884.992949] env[75346]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  884.992949] env[75346]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  884.992949] env[75346]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  884.992949] env[75346]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  884.992949] env[75346]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  884.992949] env[75346]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  884.992949] env[75346]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  884.992949] env[75346]: ERROR neutron     response = self.get(path=path, params=params)
[  884.993781] env[75346]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  884.993781] env[75346]: ERROR neutron     raise RuntimeError(msg, last_err)
[  884.993781] env[75346]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  884.993781] env[75346]: ERROR neutron 
[  887.558781] env[75503]: INFO neutron.common.config [-] Logging enabled!
[  887.559036] env[75503]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  887.559303] env[75503]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=75503) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  887.559533] env[75503]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  887.559627] env[75503]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  887.560485] env[75503]: WARNING oslo_policy.policy [None req-3f3b23e4-3d9c-4cce-a953-f641eed9d39f None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  887.560709] env[75503]: WARNING oslo_policy.policy [None req-3f3b23e4-3d9c-4cce-a953-f641eed9d39f None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  887.561907] env[75503]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-3f3b23e4-3d9c-4cce-a953-f641eed9d39f None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  887.575988] env[75503]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3f3b23e4-3d9c-4cce-a953-f641eed9d39f None None] Session token - acquiring
[  887.576835] env[75503]: DEBUG networking_nsxv3.common.locking [None req-3f3b23e4-3d9c-4cce-a953-f641eed9d39f None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=75503) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  887.577035] env[75503]: DEBUG oslo_concurrency.lockutils [None req-3f3b23e4-3d9c-4cce-a953-f641eed9d39f None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  887.577162] env[75503]: DEBUG oslo_concurrency.lockutils [None req-3f3b23e4-3d9c-4cce-a953-f641eed9d39f None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  887.577527] env[75503]: DEBUG oslo_concurrency.lockutils [None req-3f3b23e4-3d9c-4cce-a953-f641eed9d39f None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  887.586745] env[75503]: DEBUG oslo_concurrency.lockutils [None req-3f3b23e4-3d9c-4cce-a953-f641eed9d39f None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  887.586835] env[75503]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3f3b23e4-3d9c-4cce-a953-f641eed9d39f None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  887.586978] env[75503]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3f3b23e4-3d9c-4cce-a953-f641eed9d39f None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=75503) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  889.593188] env[75503]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3f3b23e4-3d9c-4cce-a953-f641eed9d39f None None] Session token - acquiring
[  889.593551] env[75503]: DEBUG networking_nsxv3.common.locking [None req-3f3b23e4-3d9c-4cce-a953-f641eed9d39f None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=75503) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  889.593797] env[75503]: DEBUG oslo_concurrency.lockutils [None req-3f3b23e4-3d9c-4cce-a953-f641eed9d39f None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  889.593943] env[75503]: DEBUG oslo_concurrency.lockutils [None req-3f3b23e4-3d9c-4cce-a953-f641eed9d39f None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  889.594225] env[75503]: DEBUG oslo_concurrency.lockutils [None req-3f3b23e4-3d9c-4cce-a953-f641eed9d39f None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  889.603787] env[75503]: DEBUG oslo_concurrency.lockutils [None req-3f3b23e4-3d9c-4cce-a953-f641eed9d39f None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  889.604075] env[75503]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3f3b23e4-3d9c-4cce-a953-f641eed9d39f None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  889.604287] env[75503]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3f3b23e4-3d9c-4cce-a953-f641eed9d39f None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=75503) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  891.605919] env[75503]: CRITICAL neutron [None req-3f3b23e4-3d9c-4cce-a953-f641eed9d39f None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  891.605919] env[75503]: ERROR neutron Traceback (most recent call last):
[  891.605919] env[75503]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  891.605919] env[75503]: ERROR neutron     sys.exit(main())
[  891.605919] env[75503]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  891.605919] env[75503]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  891.605919] env[75503]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  891.605919] env[75503]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  891.605919] env[75503]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  891.605919] env[75503]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  891.605919] env[75503]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  891.605919] env[75503]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  891.605919] env[75503]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  891.605919] env[75503]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  891.605919] env[75503]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  891.605919] env[75503]: ERROR neutron     response = self.get(path=path, params=params)
[  891.606760] env[75503]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  891.606760] env[75503]: ERROR neutron     raise RuntimeError(msg, last_err)
[  891.606760] env[75503]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  891.606760] env[75503]: ERROR neutron 
[  894.166539] env[75665]: INFO neutron.common.config [-] Logging enabled!
[  894.166886] env[75665]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  894.167085] env[75665]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=75665) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  894.167341] env[75665]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  894.167439] env[75665]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  894.168310] env[75665]: WARNING oslo_policy.policy [None req-99f9db1a-8f09-440f-a441-867822bbb616 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  894.168521] env[75665]: WARNING oslo_policy.policy [None req-99f9db1a-8f09-440f-a441-867822bbb616 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  894.169733] env[75665]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-99f9db1a-8f09-440f-a441-867822bbb616 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  894.183894] env[75665]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-99f9db1a-8f09-440f-a441-867822bbb616 None None] Session token - acquiring
[  894.184859] env[75665]: DEBUG networking_nsxv3.common.locking [None req-99f9db1a-8f09-440f-a441-867822bbb616 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=75665) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  894.185134] env[75665]: DEBUG oslo_concurrency.lockutils [None req-99f9db1a-8f09-440f-a441-867822bbb616 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75665) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  894.185265] env[75665]: DEBUG oslo_concurrency.lockutils [None req-99f9db1a-8f09-440f-a441-867822bbb616 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75665) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  894.185651] env[75665]: DEBUG oslo_concurrency.lockutils [None req-99f9db1a-8f09-440f-a441-867822bbb616 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75665) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  894.194946] env[75665]: DEBUG oslo_concurrency.lockutils [None req-99f9db1a-8f09-440f-a441-867822bbb616 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75665) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  894.195256] env[75665]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-99f9db1a-8f09-440f-a441-867822bbb616 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  894.195344] env[75665]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-99f9db1a-8f09-440f-a441-867822bbb616 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=75665) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  896.202460] env[75665]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-99f9db1a-8f09-440f-a441-867822bbb616 None None] Session token - acquiring
[  896.202460] env[75665]: DEBUG networking_nsxv3.common.locking [None req-99f9db1a-8f09-440f-a441-867822bbb616 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=75665) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  896.202460] env[75665]: DEBUG oslo_concurrency.lockutils [None req-99f9db1a-8f09-440f-a441-867822bbb616 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75665) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  896.202795] env[75665]: DEBUG oslo_concurrency.lockutils [None req-99f9db1a-8f09-440f-a441-867822bbb616 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75665) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  896.202795] env[75665]: DEBUG oslo_concurrency.lockutils [None req-99f9db1a-8f09-440f-a441-867822bbb616 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75665) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  896.212445] env[75665]: DEBUG oslo_concurrency.lockutils [None req-99f9db1a-8f09-440f-a441-867822bbb616 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75665) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  896.212705] env[75665]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-99f9db1a-8f09-440f-a441-867822bbb616 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  896.212851] env[75665]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-99f9db1a-8f09-440f-a441-867822bbb616 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=75665) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  898.215839] env[75665]: CRITICAL neutron [None req-99f9db1a-8f09-440f-a441-867822bbb616 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  898.215839] env[75665]: ERROR neutron Traceback (most recent call last):
[  898.215839] env[75665]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  898.215839] env[75665]: ERROR neutron     sys.exit(main())
[  898.215839] env[75665]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  898.215839] env[75665]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  898.215839] env[75665]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  898.215839] env[75665]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  898.215839] env[75665]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  898.215839] env[75665]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  898.215839] env[75665]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  898.215839] env[75665]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  898.215839] env[75665]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  898.215839] env[75665]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  898.215839] env[75665]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  898.215839] env[75665]: ERROR neutron     response = self.get(path=path, params=params)
[  898.216599] env[75665]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  898.216599] env[75665]: ERROR neutron     raise RuntimeError(msg, last_err)
[  898.216599] env[75665]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  898.216599] env[75665]: ERROR neutron 
[  900.861246] env[75724]: INFO neutron.common.config [-] Logging enabled!
[  900.861513] env[75724]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  900.861772] env[75724]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=75724) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  900.862034] env[75724]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  900.862137] env[75724]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  900.862979] env[75724]: WARNING oslo_policy.policy [None req-3aa7b25b-bc32-4146-85f3-2d4946bc712b None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  900.863193] env[75724]: WARNING oslo_policy.policy [None req-3aa7b25b-bc32-4146-85f3-2d4946bc712b None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  900.864475] env[75724]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-3aa7b25b-bc32-4146-85f3-2d4946bc712b None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  900.878562] env[75724]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3aa7b25b-bc32-4146-85f3-2d4946bc712b None None] Session token - acquiring
[  900.879331] env[75724]: DEBUG networking_nsxv3.common.locking [None req-3aa7b25b-bc32-4146-85f3-2d4946bc712b None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=75724) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  900.879528] env[75724]: DEBUG oslo_concurrency.lockutils [None req-3aa7b25b-bc32-4146-85f3-2d4946bc712b None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  900.879655] env[75724]: DEBUG oslo_concurrency.lockutils [None req-3aa7b25b-bc32-4146-85f3-2d4946bc712b None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  900.880062] env[75724]: DEBUG oslo_concurrency.lockutils [None req-3aa7b25b-bc32-4146-85f3-2d4946bc712b None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  900.888837] env[75724]: DEBUG oslo_concurrency.lockutils [None req-3aa7b25b-bc32-4146-85f3-2d4946bc712b None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  900.889085] env[75724]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3aa7b25b-bc32-4146-85f3-2d4946bc712b None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  900.889231] env[75724]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3aa7b25b-bc32-4146-85f3-2d4946bc712b None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=75724) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  902.895567] env[75724]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3aa7b25b-bc32-4146-85f3-2d4946bc712b None None] Session token - acquiring
[  902.895941] env[75724]: DEBUG networking_nsxv3.common.locking [None req-3aa7b25b-bc32-4146-85f3-2d4946bc712b None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=75724) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  902.896094] env[75724]: DEBUG oslo_concurrency.lockutils [None req-3aa7b25b-bc32-4146-85f3-2d4946bc712b None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  902.896256] env[75724]: DEBUG oslo_concurrency.lockutils [None req-3aa7b25b-bc32-4146-85f3-2d4946bc712b None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  902.896527] env[75724]: DEBUG oslo_concurrency.lockutils [None req-3aa7b25b-bc32-4146-85f3-2d4946bc712b None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  902.905739] env[75724]: DEBUG oslo_concurrency.lockutils [None req-3aa7b25b-bc32-4146-85f3-2d4946bc712b None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  902.905978] env[75724]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3aa7b25b-bc32-4146-85f3-2d4946bc712b None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  902.906111] env[75724]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3aa7b25b-bc32-4146-85f3-2d4946bc712b None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=75724) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  904.909085] env[75724]: CRITICAL neutron [None req-3aa7b25b-bc32-4146-85f3-2d4946bc712b None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  904.909085] env[75724]: ERROR neutron Traceback (most recent call last):
[  904.909085] env[75724]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  904.909085] env[75724]: ERROR neutron     sys.exit(main())
[  904.909085] env[75724]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  904.909085] env[75724]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  904.909085] env[75724]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  904.909085] env[75724]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  904.909085] env[75724]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  904.909085] env[75724]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  904.909085] env[75724]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  904.909085] env[75724]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  904.909085] env[75724]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  904.909085] env[75724]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  904.909085] env[75724]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  904.909085] env[75724]: ERROR neutron     response = self.get(path=path, params=params)
[  904.909902] env[75724]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  904.909902] env[75724]: ERROR neutron     raise RuntimeError(msg, last_err)
[  904.909902] env[75724]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  904.909902] env[75724]: ERROR neutron 
[  907.495941] env[75764]: INFO neutron.common.config [-] Logging enabled!
[  907.496325] env[75764]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  907.496696] env[75764]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=75764) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  907.496939] env[75764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  907.497039] env[75764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  907.497958] env[75764]: WARNING oslo_policy.policy [None req-ff9346b7-a323-4934-b454-9f4c60d7f40b None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  907.498130] env[75764]: WARNING oslo_policy.policy [None req-ff9346b7-a323-4934-b454-9f4c60d7f40b None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  907.499358] env[75764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-ff9346b7-a323-4934-b454-9f4c60d7f40b None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  907.513469] env[75764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ff9346b7-a323-4934-b454-9f4c60d7f40b None None] Session token - acquiring
[  907.514294] env[75764]: DEBUG networking_nsxv3.common.locking [None req-ff9346b7-a323-4934-b454-9f4c60d7f40b None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=75764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  907.514498] env[75764]: DEBUG oslo_concurrency.lockutils [None req-ff9346b7-a323-4934-b454-9f4c60d7f40b None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  907.514624] env[75764]: DEBUG oslo_concurrency.lockutils [None req-ff9346b7-a323-4934-b454-9f4c60d7f40b None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  907.514985] env[75764]: DEBUG oslo_concurrency.lockutils [None req-ff9346b7-a323-4934-b454-9f4c60d7f40b None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  907.524300] env[75764]: DEBUG oslo_concurrency.lockutils [None req-ff9346b7-a323-4934-b454-9f4c60d7f40b None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  907.524558] env[75764]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ff9346b7-a323-4934-b454-9f4c60d7f40b None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  907.524703] env[75764]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ff9346b7-a323-4934-b454-9f4c60d7f40b None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=75764) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  909.533071] env[75764]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ff9346b7-a323-4934-b454-9f4c60d7f40b None None] Session token - acquiring
[  909.533543] env[75764]: DEBUG networking_nsxv3.common.locking [None req-ff9346b7-a323-4934-b454-9f4c60d7f40b None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=75764) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  909.534147] env[75764]: DEBUG oslo_concurrency.lockutils [None req-ff9346b7-a323-4934-b454-9f4c60d7f40b None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  909.534147] env[75764]: DEBUG oslo_concurrency.lockutils [None req-ff9346b7-a323-4934-b454-9f4c60d7f40b None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  909.534147] env[75764]: DEBUG oslo_concurrency.lockutils [None req-ff9346b7-a323-4934-b454-9f4c60d7f40b None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  909.548756] env[75764]: DEBUG oslo_concurrency.lockutils [None req-ff9346b7-a323-4934-b454-9f4c60d7f40b None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75764) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  909.549014] env[75764]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ff9346b7-a323-4934-b454-9f4c60d7f40b None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  909.549490] env[75764]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ff9346b7-a323-4934-b454-9f4c60d7f40b None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=75764) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  911.552543] env[75764]: CRITICAL neutron [None req-ff9346b7-a323-4934-b454-9f4c60d7f40b None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  911.552543] env[75764]: ERROR neutron Traceback (most recent call last):
[  911.552543] env[75764]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  911.552543] env[75764]: ERROR neutron     sys.exit(main())
[  911.552543] env[75764]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  911.552543] env[75764]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  911.552543] env[75764]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  911.552543] env[75764]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  911.552543] env[75764]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  911.552543] env[75764]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  911.552543] env[75764]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  911.552543] env[75764]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  911.552543] env[75764]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  911.552543] env[75764]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  911.552543] env[75764]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  911.552543] env[75764]: ERROR neutron     response = self.get(path=path, params=params)
[  911.553147] env[75764]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  911.553147] env[75764]: ERROR neutron     raise RuntimeError(msg, last_err)
[  911.553147] env[75764]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  911.553147] env[75764]: ERROR neutron 
[  914.176618] env[76000]: INFO neutron.common.config [-] Logging enabled!
[  914.177093] env[76000]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  914.177612] env[76000]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=76000) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  914.177612] env[76000]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  914.177612] env[76000]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  914.178423] env[76000]: WARNING oslo_policy.policy [None req-45100555-6686-424c-bf10-eed93ed77a66 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  914.178644] env[76000]: WARNING oslo_policy.policy [None req-45100555-6686-424c-bf10-eed93ed77a66 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  914.179840] env[76000]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-45100555-6686-424c-bf10-eed93ed77a66 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  914.193869] env[76000]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-45100555-6686-424c-bf10-eed93ed77a66 None None] Session token - acquiring
[  914.194648] env[76000]: DEBUG networking_nsxv3.common.locking [None req-45100555-6686-424c-bf10-eed93ed77a66 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=76000) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  914.194833] env[76000]: DEBUG oslo_concurrency.lockutils [None req-45100555-6686-424c-bf10-eed93ed77a66 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  914.194954] env[76000]: DEBUG oslo_concurrency.lockutils [None req-45100555-6686-424c-bf10-eed93ed77a66 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  914.195312] env[76000]: DEBUG oslo_concurrency.lockutils [None req-45100555-6686-424c-bf10-eed93ed77a66 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  914.204360] env[76000]: DEBUG oslo_concurrency.lockutils [None req-45100555-6686-424c-bf10-eed93ed77a66 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  914.204594] env[76000]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-45100555-6686-424c-bf10-eed93ed77a66 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  914.204731] env[76000]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-45100555-6686-424c-bf10-eed93ed77a66 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=76000) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  916.210850] env[76000]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-45100555-6686-424c-bf10-eed93ed77a66 None None] Session token - acquiring
[  916.211391] env[76000]: DEBUG networking_nsxv3.common.locking [None req-45100555-6686-424c-bf10-eed93ed77a66 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=76000) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  916.211597] env[76000]: DEBUG oslo_concurrency.lockutils [None req-45100555-6686-424c-bf10-eed93ed77a66 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  916.211720] env[76000]: DEBUG oslo_concurrency.lockutils [None req-45100555-6686-424c-bf10-eed93ed77a66 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  916.211985] env[76000]: DEBUG oslo_concurrency.lockutils [None req-45100555-6686-424c-bf10-eed93ed77a66 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  916.221303] env[76000]: DEBUG oslo_concurrency.lockutils [None req-45100555-6686-424c-bf10-eed93ed77a66 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  916.221580] env[76000]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-45100555-6686-424c-bf10-eed93ed77a66 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  916.221724] env[76000]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-45100555-6686-424c-bf10-eed93ed77a66 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=76000) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  918.225081] env[76000]: CRITICAL neutron [None req-45100555-6686-424c-bf10-eed93ed77a66 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  918.225081] env[76000]: ERROR neutron Traceback (most recent call last):
[  918.225081] env[76000]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  918.225081] env[76000]: ERROR neutron     sys.exit(main())
[  918.225081] env[76000]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  918.225081] env[76000]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  918.225081] env[76000]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  918.225081] env[76000]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  918.225081] env[76000]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  918.225081] env[76000]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  918.225081] env[76000]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  918.225081] env[76000]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  918.225081] env[76000]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  918.225081] env[76000]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  918.225081] env[76000]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  918.225081] env[76000]: ERROR neutron     response = self.get(path=path, params=params)
[  918.226059] env[76000]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  918.226059] env[76000]: ERROR neutron     raise RuntimeError(msg, last_err)
[  918.226059] env[76000]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  918.226059] env[76000]: ERROR neutron 
[  920.876821] env[76168]: INFO neutron.common.config [-] Logging enabled!
[  920.877144] env[76168]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  920.877338] env[76168]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=76168) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  920.877586] env[76168]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  920.877680] env[76168]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  920.878548] env[76168]: WARNING oslo_policy.policy [None req-f1c46718-3b10-48a2-b35c-7dd7e77f6f8f None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  920.878818] env[76168]: WARNING oslo_policy.policy [None req-f1c46718-3b10-48a2-b35c-7dd7e77f6f8f None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  920.880113] env[76168]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-f1c46718-3b10-48a2-b35c-7dd7e77f6f8f None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  920.893858] env[76168]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f1c46718-3b10-48a2-b35c-7dd7e77f6f8f None None] Session token - acquiring
[  920.894691] env[76168]: DEBUG networking_nsxv3.common.locking [None req-f1c46718-3b10-48a2-b35c-7dd7e77f6f8f None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=76168) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  920.894886] env[76168]: DEBUG oslo_concurrency.lockutils [None req-f1c46718-3b10-48a2-b35c-7dd7e77f6f8f None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76168) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  920.895011] env[76168]: DEBUG oslo_concurrency.lockutils [None req-f1c46718-3b10-48a2-b35c-7dd7e77f6f8f None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76168) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  920.895365] env[76168]: DEBUG oslo_concurrency.lockutils [None req-f1c46718-3b10-48a2-b35c-7dd7e77f6f8f None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76168) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  920.904199] env[76168]: DEBUG oslo_concurrency.lockutils [None req-f1c46718-3b10-48a2-b35c-7dd7e77f6f8f None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76168) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  920.904513] env[76168]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f1c46718-3b10-48a2-b35c-7dd7e77f6f8f None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  920.904663] env[76168]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f1c46718-3b10-48a2-b35c-7dd7e77f6f8f None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=76168) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  922.910573] env[76168]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f1c46718-3b10-48a2-b35c-7dd7e77f6f8f None None] Session token - acquiring
[  922.910924] env[76168]: DEBUG networking_nsxv3.common.locking [None req-f1c46718-3b10-48a2-b35c-7dd7e77f6f8f None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=76168) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  922.911165] env[76168]: DEBUG oslo_concurrency.lockutils [None req-f1c46718-3b10-48a2-b35c-7dd7e77f6f8f None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76168) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  922.911223] env[76168]: DEBUG oslo_concurrency.lockutils [None req-f1c46718-3b10-48a2-b35c-7dd7e77f6f8f None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76168) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  922.911469] env[76168]: DEBUG oslo_concurrency.lockutils [None req-f1c46718-3b10-48a2-b35c-7dd7e77f6f8f None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76168) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  922.920657] env[76168]: DEBUG oslo_concurrency.lockutils [None req-f1c46718-3b10-48a2-b35c-7dd7e77f6f8f None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76168) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  922.920657] env[76168]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f1c46718-3b10-48a2-b35c-7dd7e77f6f8f None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  922.920657] env[76168]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f1c46718-3b10-48a2-b35c-7dd7e77f6f8f None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=76168) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  924.923514] env[76168]: CRITICAL neutron [None req-f1c46718-3b10-48a2-b35c-7dd7e77f6f8f None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  924.923514] env[76168]: ERROR neutron Traceback (most recent call last):
[  924.923514] env[76168]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  924.923514] env[76168]: ERROR neutron     sys.exit(main())
[  924.923514] env[76168]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  924.923514] env[76168]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  924.923514] env[76168]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  924.923514] env[76168]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  924.923514] env[76168]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  924.923514] env[76168]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  924.923514] env[76168]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  924.923514] env[76168]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  924.923514] env[76168]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  924.923514] env[76168]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  924.923514] env[76168]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  924.923514] env[76168]: ERROR neutron     response = self.get(path=path, params=params)
[  924.924263] env[76168]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  924.924263] env[76168]: ERROR neutron     raise RuntimeError(msg, last_err)
[  924.924263] env[76168]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  924.924263] env[76168]: ERROR neutron 
[  927.387836] env[76195]: INFO neutron.common.config [-] Logging enabled!
[  927.388199] env[76195]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  927.393372] env[76195]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=76195) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  927.393372] env[76195]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  927.393372] env[76195]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  927.393372] env[76195]: WARNING oslo_policy.policy [None req-38844640-95e5-4d1a-aece-9f4635e84583 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  927.393372] env[76195]: WARNING oslo_policy.policy [None req-38844640-95e5-4d1a-aece-9f4635e84583 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  927.393372] env[76195]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-38844640-95e5-4d1a-aece-9f4635e84583 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  927.405393] env[76195]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-38844640-95e5-4d1a-aece-9f4635e84583 None None] Session token - acquiring
[  927.406266] env[76195]: DEBUG networking_nsxv3.common.locking [None req-38844640-95e5-4d1a-aece-9f4635e84583 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=76195) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  927.406622] env[76195]: DEBUG oslo_concurrency.lockutils [None req-38844640-95e5-4d1a-aece-9f4635e84583 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76195) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  927.406877] env[76195]: DEBUG oslo_concurrency.lockutils [None req-38844640-95e5-4d1a-aece-9f4635e84583 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76195) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  927.407337] env[76195]: DEBUG oslo_concurrency.lockutils [None req-38844640-95e5-4d1a-aece-9f4635e84583 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76195) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  927.416216] env[76195]: DEBUG oslo_concurrency.lockutils [None req-38844640-95e5-4d1a-aece-9f4635e84583 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76195) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  927.416598] env[76195]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-38844640-95e5-4d1a-aece-9f4635e84583 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  927.416869] env[76195]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-38844640-95e5-4d1a-aece-9f4635e84583 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=76195) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  929.423071] env[76195]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-38844640-95e5-4d1a-aece-9f4635e84583 None None] Session token - acquiring
[  929.423540] env[76195]: DEBUG networking_nsxv3.common.locking [None req-38844640-95e5-4d1a-aece-9f4635e84583 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=76195) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  929.423705] env[76195]: DEBUG oslo_concurrency.lockutils [None req-38844640-95e5-4d1a-aece-9f4635e84583 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76195) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  929.423927] env[76195]: DEBUG oslo_concurrency.lockutils [None req-38844640-95e5-4d1a-aece-9f4635e84583 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76195) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  929.424115] env[76195]: DEBUG oslo_concurrency.lockutils [None req-38844640-95e5-4d1a-aece-9f4635e84583 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76195) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  929.433867] env[76195]: DEBUG oslo_concurrency.lockutils [None req-38844640-95e5-4d1a-aece-9f4635e84583 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76195) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  929.434107] env[76195]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-38844640-95e5-4d1a-aece-9f4635e84583 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  929.434247] env[76195]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-38844640-95e5-4d1a-aece-9f4635e84583 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=76195) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  931.436791] env[76195]: CRITICAL neutron [None req-38844640-95e5-4d1a-aece-9f4635e84583 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  931.436791] env[76195]: ERROR neutron Traceback (most recent call last):
[  931.436791] env[76195]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  931.436791] env[76195]: ERROR neutron     sys.exit(main())
[  931.436791] env[76195]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  931.436791] env[76195]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  931.436791] env[76195]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  931.436791] env[76195]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  931.436791] env[76195]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  931.436791] env[76195]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  931.436791] env[76195]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  931.436791] env[76195]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  931.436791] env[76195]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  931.436791] env[76195]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  931.436791] env[76195]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  931.436791] env[76195]: ERROR neutron     response = self.get(path=path, params=params)
[  931.437572] env[76195]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  931.437572] env[76195]: ERROR neutron     raise RuntimeError(msg, last_err)
[  931.437572] env[76195]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  931.437572] env[76195]: ERROR neutron 
[  933.892988] env[76244]: INFO neutron.common.config [-] Logging enabled!
[  933.893321] env[76244]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  933.893614] env[76244]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=76244) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  933.893845] env[76244]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  933.893939] env[76244]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  933.894738] env[76244]: WARNING oslo_policy.policy [None req-f235ad58-df0b-437b-9327-0e6831e5ebe9 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  933.894955] env[76244]: WARNING oslo_policy.policy [None req-f235ad58-df0b-437b-9327-0e6831e5ebe9 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  933.896127] env[76244]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-f235ad58-df0b-437b-9327-0e6831e5ebe9 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  933.910437] env[76244]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f235ad58-df0b-437b-9327-0e6831e5ebe9 None None] Session token - acquiring
[  933.911527] env[76244]: DEBUG networking_nsxv3.common.locking [None req-f235ad58-df0b-437b-9327-0e6831e5ebe9 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=76244) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  933.911821] env[76244]: DEBUG oslo_concurrency.lockutils [None req-f235ad58-df0b-437b-9327-0e6831e5ebe9 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  933.911991] env[76244]: DEBUG oslo_concurrency.lockutils [None req-f235ad58-df0b-437b-9327-0e6831e5ebe9 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  933.912415] env[76244]: DEBUG oslo_concurrency.lockutils [None req-f235ad58-df0b-437b-9327-0e6831e5ebe9 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  933.921183] env[76244]: DEBUG oslo_concurrency.lockutils [None req-f235ad58-df0b-437b-9327-0e6831e5ebe9 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  933.921430] env[76244]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f235ad58-df0b-437b-9327-0e6831e5ebe9 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  933.921575] env[76244]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f235ad58-df0b-437b-9327-0e6831e5ebe9 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=76244) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  935.927602] env[76244]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f235ad58-df0b-437b-9327-0e6831e5ebe9 None None] Session token - acquiring
[  935.928015] env[76244]: DEBUG networking_nsxv3.common.locking [None req-f235ad58-df0b-437b-9327-0e6831e5ebe9 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=76244) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  935.928125] env[76244]: DEBUG oslo_concurrency.lockutils [None req-f235ad58-df0b-437b-9327-0e6831e5ebe9 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  935.928253] env[76244]: DEBUG oslo_concurrency.lockutils [None req-f235ad58-df0b-437b-9327-0e6831e5ebe9 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  935.928526] env[76244]: DEBUG oslo_concurrency.lockutils [None req-f235ad58-df0b-437b-9327-0e6831e5ebe9 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  935.937798] env[76244]: DEBUG oslo_concurrency.lockutils [None req-f235ad58-df0b-437b-9327-0e6831e5ebe9 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  935.938082] env[76244]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f235ad58-df0b-437b-9327-0e6831e5ebe9 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  935.938219] env[76244]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f235ad58-df0b-437b-9327-0e6831e5ebe9 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=76244) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  937.952025] env[76244]: CRITICAL neutron [None req-f235ad58-df0b-437b-9327-0e6831e5ebe9 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  937.952025] env[76244]: ERROR neutron Traceback (most recent call last):
[  937.952025] env[76244]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  937.952025] env[76244]: ERROR neutron     sys.exit(main())
[  937.952025] env[76244]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  937.952025] env[76244]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  937.952025] env[76244]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  937.952025] env[76244]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  937.952025] env[76244]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  937.952025] env[76244]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  937.952025] env[76244]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  937.952025] env[76244]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  937.952025] env[76244]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  937.952025] env[76244]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  937.952025] env[76244]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  937.952025] env[76244]: ERROR neutron     response = self.get(path=path, params=params)
[  937.953797] env[76244]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  937.953797] env[76244]: ERROR neutron     raise RuntimeError(msg, last_err)
[  937.953797] env[76244]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  937.953797] env[76244]: ERROR neutron 
[  940.602175] env[76292]: INFO neutron.common.config [-] Logging enabled!
[  940.602546] env[76292]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  940.602728] env[76292]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=76292) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  940.602954] env[76292]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  940.603051] env[76292]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  940.603889] env[76292]: WARNING oslo_policy.policy [None req-30c7b7c8-5dad-49c0-87e2-2b50793866a9 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  940.604176] env[76292]: WARNING oslo_policy.policy [None req-30c7b7c8-5dad-49c0-87e2-2b50793866a9 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  940.605503] env[76292]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-30c7b7c8-5dad-49c0-87e2-2b50793866a9 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  940.620672] env[76292]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-30c7b7c8-5dad-49c0-87e2-2b50793866a9 None None] Session token - acquiring
[  940.621696] env[76292]: DEBUG networking_nsxv3.common.locking [None req-30c7b7c8-5dad-49c0-87e2-2b50793866a9 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=76292) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  940.622063] env[76292]: DEBUG oslo_concurrency.lockutils [None req-30c7b7c8-5dad-49c0-87e2-2b50793866a9 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  940.623448] env[76292]: DEBUG oslo_concurrency.lockutils [None req-30c7b7c8-5dad-49c0-87e2-2b50793866a9 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  940.623981] env[76292]: DEBUG oslo_concurrency.lockutils [None req-30c7b7c8-5dad-49c0-87e2-2b50793866a9 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  940.634857] env[76292]: DEBUG oslo_concurrency.lockutils [None req-30c7b7c8-5dad-49c0-87e2-2b50793866a9 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  940.635268] env[76292]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-30c7b7c8-5dad-49c0-87e2-2b50793866a9 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  940.635734] env[76292]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-30c7b7c8-5dad-49c0-87e2-2b50793866a9 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=76292) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  942.642263] env[76292]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-30c7b7c8-5dad-49c0-87e2-2b50793866a9 None None] Session token - acquiring
[  942.642723] env[76292]: DEBUG networking_nsxv3.common.locking [None req-30c7b7c8-5dad-49c0-87e2-2b50793866a9 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=76292) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  942.642921] env[76292]: DEBUG oslo_concurrency.lockutils [None req-30c7b7c8-5dad-49c0-87e2-2b50793866a9 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  942.643039] env[76292]: DEBUG oslo_concurrency.lockutils [None req-30c7b7c8-5dad-49c0-87e2-2b50793866a9 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  942.643325] env[76292]: DEBUG oslo_concurrency.lockutils [None req-30c7b7c8-5dad-49c0-87e2-2b50793866a9 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  942.654314] env[76292]: DEBUG oslo_concurrency.lockutils [None req-30c7b7c8-5dad-49c0-87e2-2b50793866a9 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  942.654507] env[76292]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-30c7b7c8-5dad-49c0-87e2-2b50793866a9 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  942.654645] env[76292]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-30c7b7c8-5dad-49c0-87e2-2b50793866a9 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=76292) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  944.656956] env[76292]: CRITICAL neutron [None req-30c7b7c8-5dad-49c0-87e2-2b50793866a9 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  944.656956] env[76292]: ERROR neutron Traceback (most recent call last):
[  944.656956] env[76292]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  944.656956] env[76292]: ERROR neutron     sys.exit(main())
[  944.656956] env[76292]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  944.656956] env[76292]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  944.656956] env[76292]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  944.656956] env[76292]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  944.656956] env[76292]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  944.656956] env[76292]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  944.656956] env[76292]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  944.656956] env[76292]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  944.656956] env[76292]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  944.656956] env[76292]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  944.656956] env[76292]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  944.656956] env[76292]: ERROR neutron     response = self.get(path=path, params=params)
[  944.657714] env[76292]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  944.657714] env[76292]: ERROR neutron     raise RuntimeError(msg, last_err)
[  944.657714] env[76292]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  944.657714] env[76292]: ERROR neutron 
[  947.186488] env[76528]: INFO neutron.common.config [-] Logging enabled!
[  947.186807] env[76528]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  947.187033] env[76528]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=76528) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  947.187294] env[76528]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  947.187441] env[76528]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  947.188341] env[76528]: WARNING oslo_policy.policy [None req-5a69f5ba-64a2-4149-a069-2fdb6be32130 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  947.188574] env[76528]: WARNING oslo_policy.policy [None req-5a69f5ba-64a2-4149-a069-2fdb6be32130 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  947.189975] env[76528]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-5a69f5ba-64a2-4149-a069-2fdb6be32130 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  947.203949] env[76528]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5a69f5ba-64a2-4149-a069-2fdb6be32130 None None] Session token - acquiring
[  947.204796] env[76528]: DEBUG networking_nsxv3.common.locking [None req-5a69f5ba-64a2-4149-a069-2fdb6be32130 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=76528) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  947.204995] env[76528]: DEBUG oslo_concurrency.lockutils [None req-5a69f5ba-64a2-4149-a069-2fdb6be32130 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76528) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  947.205126] env[76528]: DEBUG oslo_concurrency.lockutils [None req-5a69f5ba-64a2-4149-a069-2fdb6be32130 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76528) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  947.205484] env[76528]: DEBUG oslo_concurrency.lockutils [None req-5a69f5ba-64a2-4149-a069-2fdb6be32130 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76528) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  947.214157] env[76528]: DEBUG oslo_concurrency.lockutils [None req-5a69f5ba-64a2-4149-a069-2fdb6be32130 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76528) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  947.214469] env[76528]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5a69f5ba-64a2-4149-a069-2fdb6be32130 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  947.214670] env[76528]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5a69f5ba-64a2-4149-a069-2fdb6be32130 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=76528) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  949.220686] env[76528]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5a69f5ba-64a2-4149-a069-2fdb6be32130 None None] Session token - acquiring
[  949.221151] env[76528]: DEBUG networking_nsxv3.common.locking [None req-5a69f5ba-64a2-4149-a069-2fdb6be32130 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=76528) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  949.221370] env[76528]: DEBUG oslo_concurrency.lockutils [None req-5a69f5ba-64a2-4149-a069-2fdb6be32130 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76528) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  949.221501] env[76528]: DEBUG oslo_concurrency.lockutils [None req-5a69f5ba-64a2-4149-a069-2fdb6be32130 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76528) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  949.221774] env[76528]: DEBUG oslo_concurrency.lockutils [None req-5a69f5ba-64a2-4149-a069-2fdb6be32130 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76528) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  949.230749] env[76528]: DEBUG oslo_concurrency.lockutils [None req-5a69f5ba-64a2-4149-a069-2fdb6be32130 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76528) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  949.230975] env[76528]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5a69f5ba-64a2-4149-a069-2fdb6be32130 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  949.231109] env[76528]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5a69f5ba-64a2-4149-a069-2fdb6be32130 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=76528) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  951.233148] env[76528]: CRITICAL neutron [None req-5a69f5ba-64a2-4149-a069-2fdb6be32130 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  951.233148] env[76528]: ERROR neutron Traceback (most recent call last):
[  951.233148] env[76528]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  951.233148] env[76528]: ERROR neutron     sys.exit(main())
[  951.233148] env[76528]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  951.233148] env[76528]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  951.233148] env[76528]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  951.233148] env[76528]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  951.233148] env[76528]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  951.233148] env[76528]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  951.233148] env[76528]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  951.233148] env[76528]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  951.233148] env[76528]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  951.233148] env[76528]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  951.233148] env[76528]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  951.233148] env[76528]: ERROR neutron     response = self.get(path=path, params=params)
[  951.233885] env[76528]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  951.233885] env[76528]: ERROR neutron     raise RuntimeError(msg, last_err)
[  951.233885] env[76528]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  951.233885] env[76528]: ERROR neutron 
[  953.639659] env[76614]: INFO neutron.common.config [-] Logging enabled!
[  953.640025] env[76614]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  953.640282] env[76614]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=76614) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  953.640517] env[76614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  953.640613] env[76614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  953.641491] env[76614]: WARNING oslo_policy.policy [None req-2d8ca3ab-97e0-44b7-a9ca-a024e974c758 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  953.641719] env[76614]: WARNING oslo_policy.policy [None req-2d8ca3ab-97e0-44b7-a9ca-a024e974c758 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  953.642937] env[76614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-2d8ca3ab-97e0-44b7-a9ca-a024e974c758 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  953.657870] env[76614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-2d8ca3ab-97e0-44b7-a9ca-a024e974c758 None None] Session token - acquiring
[  953.659254] env[76614]: DEBUG networking_nsxv3.common.locking [None req-2d8ca3ab-97e0-44b7-a9ca-a024e974c758 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=76614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  953.659615] env[76614]: DEBUG oslo_concurrency.lockutils [None req-2d8ca3ab-97e0-44b7-a9ca-a024e974c758 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  953.659846] env[76614]: DEBUG oslo_concurrency.lockutils [None req-2d8ca3ab-97e0-44b7-a9ca-a024e974c758 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  953.660351] env[76614]: DEBUG oslo_concurrency.lockutils [None req-2d8ca3ab-97e0-44b7-a9ca-a024e974c758 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  953.670083] env[76614]: DEBUG oslo_concurrency.lockutils [None req-2d8ca3ab-97e0-44b7-a9ca-a024e974c758 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  953.670526] env[76614]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-2d8ca3ab-97e0-44b7-a9ca-a024e974c758 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  953.670784] env[76614]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-2d8ca3ab-97e0-44b7-a9ca-a024e974c758 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=76614) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  955.676998] env[76614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-2d8ca3ab-97e0-44b7-a9ca-a024e974c758 None None] Session token - acquiring
[  955.677510] env[76614]: DEBUG networking_nsxv3.common.locking [None req-2d8ca3ab-97e0-44b7-a9ca-a024e974c758 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=76614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  955.677792] env[76614]: DEBUG oslo_concurrency.lockutils [None req-2d8ca3ab-97e0-44b7-a9ca-a024e974c758 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  955.677999] env[76614]: DEBUG oslo_concurrency.lockutils [None req-2d8ca3ab-97e0-44b7-a9ca-a024e974c758 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  955.678335] env[76614]: DEBUG oslo_concurrency.lockutils [None req-2d8ca3ab-97e0-44b7-a9ca-a024e974c758 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  955.687402] env[76614]: DEBUG oslo_concurrency.lockutils [None req-2d8ca3ab-97e0-44b7-a9ca-a024e974c758 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  955.687705] env[76614]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-2d8ca3ab-97e0-44b7-a9ca-a024e974c758 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  955.687904] env[76614]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-2d8ca3ab-97e0-44b7-a9ca-a024e974c758 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=76614) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  957.688883] env[76614]: CRITICAL neutron [None req-2d8ca3ab-97e0-44b7-a9ca-a024e974c758 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  957.688883] env[76614]: ERROR neutron Traceback (most recent call last):
[  957.688883] env[76614]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  957.688883] env[76614]: ERROR neutron     sys.exit(main())
[  957.688883] env[76614]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  957.688883] env[76614]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  957.688883] env[76614]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  957.688883] env[76614]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  957.688883] env[76614]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  957.688883] env[76614]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  957.688883] env[76614]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  957.688883] env[76614]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  957.688883] env[76614]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  957.688883] env[76614]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  957.688883] env[76614]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  957.688883] env[76614]: ERROR neutron     response = self.get(path=path, params=params)
[  957.689732] env[76614]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  957.689732] env[76614]: ERROR neutron     raise RuntimeError(msg, last_err)
[  957.689732] env[76614]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  957.689732] env[76614]: ERROR neutron 
[  960.117789] env[76685]: INFO neutron.common.config [-] Logging enabled!
[  960.118184] env[76685]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  960.118348] env[76685]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=76685) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  960.118577] env[76685]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  960.118671] env[76685]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  960.119516] env[76685]: WARNING oslo_policy.policy [None req-410bb563-05cb-4e7d-b01b-c3fecbb18b48 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  960.119740] env[76685]: WARNING oslo_policy.policy [None req-410bb563-05cb-4e7d-b01b-c3fecbb18b48 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  960.121036] env[76685]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-410bb563-05cb-4e7d-b01b-c3fecbb18b48 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  960.135127] env[76685]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-410bb563-05cb-4e7d-b01b-c3fecbb18b48 None None] Session token - acquiring
[  960.135869] env[76685]: DEBUG networking_nsxv3.common.locking [None req-410bb563-05cb-4e7d-b01b-c3fecbb18b48 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=76685) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  960.136100] env[76685]: DEBUG oslo_concurrency.lockutils [None req-410bb563-05cb-4e7d-b01b-c3fecbb18b48 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76685) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  960.136243] env[76685]: DEBUG oslo_concurrency.lockutils [None req-410bb563-05cb-4e7d-b01b-c3fecbb18b48 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76685) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  960.136606] env[76685]: DEBUG oslo_concurrency.lockutils [None req-410bb563-05cb-4e7d-b01b-c3fecbb18b48 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76685) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  960.145435] env[76685]: DEBUG oslo_concurrency.lockutils [None req-410bb563-05cb-4e7d-b01b-c3fecbb18b48 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76685) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  960.145678] env[76685]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-410bb563-05cb-4e7d-b01b-c3fecbb18b48 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  960.145823] env[76685]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-410bb563-05cb-4e7d-b01b-c3fecbb18b48 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=76685) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  962.152401] env[76685]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-410bb563-05cb-4e7d-b01b-c3fecbb18b48 None None] Session token - acquiring
[  962.152788] env[76685]: DEBUG networking_nsxv3.common.locking [None req-410bb563-05cb-4e7d-b01b-c3fecbb18b48 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=76685) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  962.153019] env[76685]: DEBUG oslo_concurrency.lockutils [None req-410bb563-05cb-4e7d-b01b-c3fecbb18b48 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76685) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  962.153153] env[76685]: DEBUG oslo_concurrency.lockutils [None req-410bb563-05cb-4e7d-b01b-c3fecbb18b48 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76685) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  962.153439] env[76685]: DEBUG oslo_concurrency.lockutils [None req-410bb563-05cb-4e7d-b01b-c3fecbb18b48 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76685) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  962.163292] env[76685]: DEBUG oslo_concurrency.lockutils [None req-410bb563-05cb-4e7d-b01b-c3fecbb18b48 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76685) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  962.163549] env[76685]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-410bb563-05cb-4e7d-b01b-c3fecbb18b48 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  962.163681] env[76685]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-410bb563-05cb-4e7d-b01b-c3fecbb18b48 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=76685) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  964.164892] env[76685]: CRITICAL neutron [None req-410bb563-05cb-4e7d-b01b-c3fecbb18b48 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  964.164892] env[76685]: ERROR neutron Traceback (most recent call last):
[  964.164892] env[76685]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  964.164892] env[76685]: ERROR neutron     sys.exit(main())
[  964.164892] env[76685]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  964.164892] env[76685]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  964.164892] env[76685]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  964.164892] env[76685]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  964.164892] env[76685]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  964.164892] env[76685]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  964.164892] env[76685]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  964.164892] env[76685]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  964.164892] env[76685]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  964.164892] env[76685]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  964.164892] env[76685]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  964.164892] env[76685]: ERROR neutron     response = self.get(path=path, params=params)
[  964.165569] env[76685]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  964.165569] env[76685]: ERROR neutron     raise RuntimeError(msg, last_err)
[  964.165569] env[76685]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  964.165569] env[76685]: ERROR neutron 
[  966.762285] env[76734]: INFO neutron.common.config [-] Logging enabled!
[  966.762629] env[76734]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  966.762808] env[76734]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=76734) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  966.763028] env[76734]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  966.763116] env[76734]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  966.763950] env[76734]: WARNING oslo_policy.policy [None req-23262d61-c246-498f-9552-a7dd26de105e None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  966.764178] env[76734]: WARNING oslo_policy.policy [None req-23262d61-c246-498f-9552-a7dd26de105e None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  966.765394] env[76734]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-23262d61-c246-498f-9552-a7dd26de105e None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  966.784878] env[76734]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-23262d61-c246-498f-9552-a7dd26de105e None None] Session token - acquiring
[  966.785873] env[76734]: DEBUG networking_nsxv3.common.locking [None req-23262d61-c246-498f-9552-a7dd26de105e None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=76734) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  966.786076] env[76734]: DEBUG oslo_concurrency.lockutils [None req-23262d61-c246-498f-9552-a7dd26de105e None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  966.786198] env[76734]: DEBUG oslo_concurrency.lockutils [None req-23262d61-c246-498f-9552-a7dd26de105e None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  966.786576] env[76734]: DEBUG oslo_concurrency.lockutils [None req-23262d61-c246-498f-9552-a7dd26de105e None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  966.796169] env[76734]: DEBUG oslo_concurrency.lockutils [None req-23262d61-c246-498f-9552-a7dd26de105e None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  966.796432] env[76734]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-23262d61-c246-498f-9552-a7dd26de105e None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  966.796576] env[76734]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-23262d61-c246-498f-9552-a7dd26de105e None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=76734) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  968.802743] env[76734]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-23262d61-c246-498f-9552-a7dd26de105e None None] Session token - acquiring
[  968.803128] env[76734]: DEBUG networking_nsxv3.common.locking [None req-23262d61-c246-498f-9552-a7dd26de105e None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=76734) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  968.803323] env[76734]: DEBUG oslo_concurrency.lockutils [None req-23262d61-c246-498f-9552-a7dd26de105e None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  968.803446] env[76734]: DEBUG oslo_concurrency.lockutils [None req-23262d61-c246-498f-9552-a7dd26de105e None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  968.803724] env[76734]: DEBUG oslo_concurrency.lockutils [None req-23262d61-c246-498f-9552-a7dd26de105e None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  968.812829] env[76734]: DEBUG oslo_concurrency.lockutils [None req-23262d61-c246-498f-9552-a7dd26de105e None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76734) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  968.813063] env[76734]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-23262d61-c246-498f-9552-a7dd26de105e None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  968.813202] env[76734]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-23262d61-c246-498f-9552-a7dd26de105e None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=76734) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  970.816273] env[76734]: CRITICAL neutron [None req-23262d61-c246-498f-9552-a7dd26de105e None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  970.816273] env[76734]: ERROR neutron Traceback (most recent call last):
[  970.816273] env[76734]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  970.816273] env[76734]: ERROR neutron     sys.exit(main())
[  970.816273] env[76734]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  970.816273] env[76734]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  970.816273] env[76734]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  970.816273] env[76734]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  970.816273] env[76734]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  970.816273] env[76734]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  970.816273] env[76734]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  970.816273] env[76734]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  970.816273] env[76734]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  970.816273] env[76734]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  970.816273] env[76734]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  970.816273] env[76734]: ERROR neutron     response = self.get(path=path, params=params)
[  970.817060] env[76734]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  970.817060] env[76734]: ERROR neutron     raise RuntimeError(msg, last_err)
[  970.817060] env[76734]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  970.817060] env[76734]: ERROR neutron 
[  973.483660] env[76826]: INFO neutron.common.config [-] Logging enabled!
[  973.483974] env[76826]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  973.484271] env[76826]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=76826) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  973.484498] env[76826]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  973.484592] env[76826]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  973.485444] env[76826]: WARNING oslo_policy.policy [None req-3fc99b62-dbef-4aa3-a201-df90336b3f34 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  973.485740] env[76826]: WARNING oslo_policy.policy [None req-3fc99b62-dbef-4aa3-a201-df90336b3f34 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  973.486955] env[76826]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-3fc99b62-dbef-4aa3-a201-df90336b3f34 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  973.507220] env[76826]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3fc99b62-dbef-4aa3-a201-df90336b3f34 None None] Session token - acquiring
[  973.508024] env[76826]: DEBUG networking_nsxv3.common.locking [None req-3fc99b62-dbef-4aa3-a201-df90336b3f34 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=76826) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  973.508224] env[76826]: DEBUG oslo_concurrency.lockutils [None req-3fc99b62-dbef-4aa3-a201-df90336b3f34 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  973.508350] env[76826]: DEBUG oslo_concurrency.lockutils [None req-3fc99b62-dbef-4aa3-a201-df90336b3f34 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  973.508712] env[76826]: DEBUG oslo_concurrency.lockutils [None req-3fc99b62-dbef-4aa3-a201-df90336b3f34 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  973.518329] env[76826]: DEBUG oslo_concurrency.lockutils [None req-3fc99b62-dbef-4aa3-a201-df90336b3f34 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  973.518583] env[76826]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3fc99b62-dbef-4aa3-a201-df90336b3f34 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  973.518725] env[76826]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3fc99b62-dbef-4aa3-a201-df90336b3f34 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=76826) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  975.524666] env[76826]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3fc99b62-dbef-4aa3-a201-df90336b3f34 None None] Session token - acquiring
[  975.525027] env[76826]: DEBUG networking_nsxv3.common.locking [None req-3fc99b62-dbef-4aa3-a201-df90336b3f34 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=76826) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  975.525135] env[76826]: DEBUG oslo_concurrency.lockutils [None req-3fc99b62-dbef-4aa3-a201-df90336b3f34 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  975.525255] env[76826]: DEBUG oslo_concurrency.lockutils [None req-3fc99b62-dbef-4aa3-a201-df90336b3f34 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  975.525538] env[76826]: DEBUG oslo_concurrency.lockutils [None req-3fc99b62-dbef-4aa3-a201-df90336b3f34 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  975.534843] env[76826]: DEBUG oslo_concurrency.lockutils [None req-3fc99b62-dbef-4aa3-a201-df90336b3f34 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  975.535084] env[76826]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3fc99b62-dbef-4aa3-a201-df90336b3f34 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  975.535227] env[76826]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3fc99b62-dbef-4aa3-a201-df90336b3f34 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=76826) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  977.536913] env[76826]: CRITICAL neutron [None req-3fc99b62-dbef-4aa3-a201-df90336b3f34 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  977.536913] env[76826]: ERROR neutron Traceback (most recent call last):
[  977.536913] env[76826]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  977.536913] env[76826]: ERROR neutron     sys.exit(main())
[  977.536913] env[76826]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  977.536913] env[76826]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  977.536913] env[76826]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  977.536913] env[76826]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  977.536913] env[76826]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  977.536913] env[76826]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  977.536913] env[76826]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  977.536913] env[76826]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  977.536913] env[76826]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  977.536913] env[76826]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  977.536913] env[76826]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  977.536913] env[76826]: ERROR neutron     response = self.get(path=path, params=params)
[  977.537686] env[76826]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  977.537686] env[76826]: ERROR neutron     raise RuntimeError(msg, last_err)
[  977.537686] env[76826]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  977.537686] env[76826]: ERROR neutron 
[  980.150628] env[77197]: INFO neutron.common.config [-] Logging enabled!
[  980.150928] env[77197]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  980.151169] env[77197]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=77197) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  980.151405] env[77197]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  980.151498] env[77197]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  980.152359] env[77197]: WARNING oslo_policy.policy [None req-6bbd0826-560e-4304-b529-ecc415a7b63a None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  980.152577] env[77197]: WARNING oslo_policy.policy [None req-6bbd0826-560e-4304-b529-ecc415a7b63a None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  980.154005] env[77197]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-6bbd0826-560e-4304-b529-ecc415a7b63a None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  980.168244] env[77197]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-6bbd0826-560e-4304-b529-ecc415a7b63a None None] Session token - acquiring
[  980.169720] env[77197]: DEBUG networking_nsxv3.common.locking [None req-6bbd0826-560e-4304-b529-ecc415a7b63a None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=77197) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  980.169914] env[77197]: DEBUG oslo_concurrency.lockutils [None req-6bbd0826-560e-4304-b529-ecc415a7b63a None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77197) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  980.170086] env[77197]: DEBUG oslo_concurrency.lockutils [None req-6bbd0826-560e-4304-b529-ecc415a7b63a None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77197) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  980.170456] env[77197]: DEBUG oslo_concurrency.lockutils [None req-6bbd0826-560e-4304-b529-ecc415a7b63a None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77197) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  980.180407] env[77197]: DEBUG oslo_concurrency.lockutils [None req-6bbd0826-560e-4304-b529-ecc415a7b63a None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77197) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  980.180649] env[77197]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-6bbd0826-560e-4304-b529-ecc415a7b63a None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  980.180789] env[77197]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-6bbd0826-560e-4304-b529-ecc415a7b63a None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=77197) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  982.189224] env[77197]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-6bbd0826-560e-4304-b529-ecc415a7b63a None None] Session token - acquiring
[  982.189224] env[77197]: DEBUG networking_nsxv3.common.locking [None req-6bbd0826-560e-4304-b529-ecc415a7b63a None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=77197) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  982.189224] env[77197]: DEBUG oslo_concurrency.lockutils [None req-6bbd0826-560e-4304-b529-ecc415a7b63a None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77197) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  982.189839] env[77197]: DEBUG oslo_concurrency.lockutils [None req-6bbd0826-560e-4304-b529-ecc415a7b63a None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77197) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  982.189839] env[77197]: DEBUG oslo_concurrency.lockutils [None req-6bbd0826-560e-4304-b529-ecc415a7b63a None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77197) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  982.197627] env[77197]: DEBUG oslo_concurrency.lockutils [None req-6bbd0826-560e-4304-b529-ecc415a7b63a None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77197) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  982.197893] env[77197]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-6bbd0826-560e-4304-b529-ecc415a7b63a None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  982.198210] env[77197]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-6bbd0826-560e-4304-b529-ecc415a7b63a None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=77197) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  984.200928] env[77197]: CRITICAL neutron [None req-6bbd0826-560e-4304-b529-ecc415a7b63a None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  984.200928] env[77197]: ERROR neutron Traceback (most recent call last):
[  984.200928] env[77197]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  984.200928] env[77197]: ERROR neutron     sys.exit(main())
[  984.200928] env[77197]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  984.200928] env[77197]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  984.200928] env[77197]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  984.200928] env[77197]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  984.200928] env[77197]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  984.200928] env[77197]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  984.200928] env[77197]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  984.200928] env[77197]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  984.200928] env[77197]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  984.200928] env[77197]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  984.200928] env[77197]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  984.200928] env[77197]: ERROR neutron     response = self.get(path=path, params=params)
[  984.201623] env[77197]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  984.201623] env[77197]: ERROR neutron     raise RuntimeError(msg, last_err)
[  984.201623] env[77197]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  984.201623] env[77197]: ERROR neutron 
[  986.572576] env[77295]: INFO neutron.common.config [-] Logging enabled!
[  986.572976] env[77295]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  986.573109] env[77295]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=77295) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  986.573293] env[77295]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  986.573386] env[77295]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  986.574299] env[77295]: WARNING oslo_policy.policy [None req-81f52455-96f7-4984-862f-fe0cb8bd1e79 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  986.574452] env[77295]: WARNING oslo_policy.policy [None req-81f52455-96f7-4984-862f-fe0cb8bd1e79 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  986.575635] env[77295]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-81f52455-96f7-4984-862f-fe0cb8bd1e79 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  986.589771] env[77295]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-81f52455-96f7-4984-862f-fe0cb8bd1e79 None None] Session token - acquiring
[  986.590582] env[77295]: DEBUG networking_nsxv3.common.locking [None req-81f52455-96f7-4984-862f-fe0cb8bd1e79 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=77295) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  986.590781] env[77295]: DEBUG oslo_concurrency.lockutils [None req-81f52455-96f7-4984-862f-fe0cb8bd1e79 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  986.590907] env[77295]: DEBUG oslo_concurrency.lockutils [None req-81f52455-96f7-4984-862f-fe0cb8bd1e79 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  986.591293] env[77295]: DEBUG oslo_concurrency.lockutils [None req-81f52455-96f7-4984-862f-fe0cb8bd1e79 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  986.600299] env[77295]: DEBUG oslo_concurrency.lockutils [None req-81f52455-96f7-4984-862f-fe0cb8bd1e79 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  986.600544] env[77295]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-81f52455-96f7-4984-862f-fe0cb8bd1e79 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  986.600907] env[77295]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-81f52455-96f7-4984-862f-fe0cb8bd1e79 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=77295) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  988.606823] env[77295]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-81f52455-96f7-4984-862f-fe0cb8bd1e79 None None] Session token - acquiring
[  988.607214] env[77295]: DEBUG networking_nsxv3.common.locking [None req-81f52455-96f7-4984-862f-fe0cb8bd1e79 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=77295) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  988.607445] env[77295]: DEBUG oslo_concurrency.lockutils [None req-81f52455-96f7-4984-862f-fe0cb8bd1e79 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  988.607574] env[77295]: DEBUG oslo_concurrency.lockutils [None req-81f52455-96f7-4984-862f-fe0cb8bd1e79 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  988.607847] env[77295]: DEBUG oslo_concurrency.lockutils [None req-81f52455-96f7-4984-862f-fe0cb8bd1e79 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  988.616864] env[77295]: DEBUG oslo_concurrency.lockutils [None req-81f52455-96f7-4984-862f-fe0cb8bd1e79 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  988.617095] env[77295]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-81f52455-96f7-4984-862f-fe0cb8bd1e79 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  988.617234] env[77295]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-81f52455-96f7-4984-862f-fe0cb8bd1e79 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=77295) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  990.620284] env[77295]: CRITICAL neutron [None req-81f52455-96f7-4984-862f-fe0cb8bd1e79 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  990.620284] env[77295]: ERROR neutron Traceback (most recent call last):
[  990.620284] env[77295]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  990.620284] env[77295]: ERROR neutron     sys.exit(main())
[  990.620284] env[77295]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  990.620284] env[77295]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  990.620284] env[77295]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  990.620284] env[77295]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  990.620284] env[77295]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  990.620284] env[77295]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  990.620284] env[77295]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  990.620284] env[77295]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  990.620284] env[77295]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  990.620284] env[77295]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  990.620284] env[77295]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  990.620284] env[77295]: ERROR neutron     response = self.get(path=path, params=params)
[  990.621423] env[77295]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  990.621423] env[77295]: ERROR neutron     raise RuntimeError(msg, last_err)
[  990.621423] env[77295]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  990.621423] env[77295]: ERROR neutron 
[  993.167599] env[77347]: INFO neutron.common.config [-] Logging enabled!
[  993.168038] env[77347]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  993.168226] env[77347]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=77347) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  993.168475] env[77347]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  993.168569] env[77347]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  993.169392] env[77347]: WARNING oslo_policy.policy [None req-6decb900-46cd-4a67-a78c-c0819a7cff5a None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  993.169613] env[77347]: WARNING oslo_policy.policy [None req-6decb900-46cd-4a67-a78c-c0819a7cff5a None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  993.170847] env[77347]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-6decb900-46cd-4a67-a78c-c0819a7cff5a None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  993.185267] env[77347]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-6decb900-46cd-4a67-a78c-c0819a7cff5a None None] Session token - acquiring
[  993.186046] env[77347]: DEBUG networking_nsxv3.common.locking [None req-6decb900-46cd-4a67-a78c-c0819a7cff5a None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=77347) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  993.186255] env[77347]: DEBUG oslo_concurrency.lockutils [None req-6decb900-46cd-4a67-a78c-c0819a7cff5a None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77347) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  993.186381] env[77347]: DEBUG oslo_concurrency.lockutils [None req-6decb900-46cd-4a67-a78c-c0819a7cff5a None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77347) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  993.186748] env[77347]: DEBUG oslo_concurrency.lockutils [None req-6decb900-46cd-4a67-a78c-c0819a7cff5a None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77347) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  993.196146] env[77347]: DEBUG oslo_concurrency.lockutils [None req-6decb900-46cd-4a67-a78c-c0819a7cff5a None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77347) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  993.196425] env[77347]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-6decb900-46cd-4a67-a78c-c0819a7cff5a None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  993.196566] env[77347]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-6decb900-46cd-4a67-a78c-c0819a7cff5a None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=77347) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  995.202485] env[77347]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-6decb900-46cd-4a67-a78c-c0819a7cff5a None None] Session token - acquiring
[  995.202875] env[77347]: DEBUG networking_nsxv3.common.locking [None req-6decb900-46cd-4a67-a78c-c0819a7cff5a None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=77347) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  995.202960] env[77347]: DEBUG oslo_concurrency.lockutils [None req-6decb900-46cd-4a67-a78c-c0819a7cff5a None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77347) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  995.203086] env[77347]: DEBUG oslo_concurrency.lockutils [None req-6decb900-46cd-4a67-a78c-c0819a7cff5a None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77347) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  995.203375] env[77347]: DEBUG oslo_concurrency.lockutils [None req-6decb900-46cd-4a67-a78c-c0819a7cff5a None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77347) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  995.212308] env[77347]: DEBUG oslo_concurrency.lockutils [None req-6decb900-46cd-4a67-a78c-c0819a7cff5a None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77347) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  995.212567] env[77347]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-6decb900-46cd-4a67-a78c-c0819a7cff5a None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  995.212711] env[77347]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-6decb900-46cd-4a67-a78c-c0819a7cff5a None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=77347) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  997.215699] env[77347]: CRITICAL neutron [None req-6decb900-46cd-4a67-a78c-c0819a7cff5a None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  997.215699] env[77347]: ERROR neutron Traceback (most recent call last):
[  997.215699] env[77347]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  997.215699] env[77347]: ERROR neutron     sys.exit(main())
[  997.215699] env[77347]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  997.215699] env[77347]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  997.215699] env[77347]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  997.215699] env[77347]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  997.215699] env[77347]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  997.215699] env[77347]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  997.215699] env[77347]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  997.215699] env[77347]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  997.215699] env[77347]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  997.215699] env[77347]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  997.215699] env[77347]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  997.215699] env[77347]: ERROR neutron     response = self.get(path=path, params=params)
[  997.216526] env[77347]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  997.216526] env[77347]: ERROR neutron     raise RuntimeError(msg, last_err)
[  997.216526] env[77347]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  997.216526] env[77347]: ERROR neutron 
[  999.561267] env[77391]: INFO neutron.common.config [-] Logging enabled!
[  999.561662] env[77391]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[  999.561782] env[77391]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=77391) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  999.562005] env[77391]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  999.562090] env[77391]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  999.562901] env[77391]: WARNING oslo_policy.policy [None req-42a48744-b396-4538-87e0-9e0eebc40f5c None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  999.563117] env[77391]: WARNING oslo_policy.policy [None req-42a48744-b396-4538-87e0-9e0eebc40f5c None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  999.564338] env[77391]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-42a48744-b396-4538-87e0-9e0eebc40f5c None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  999.578295] env[77391]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-42a48744-b396-4538-87e0-9e0eebc40f5c None None] Session token - acquiring
[  999.579037] env[77391]: DEBUG networking_nsxv3.common.locking [None req-42a48744-b396-4538-87e0-9e0eebc40f5c None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=77391) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  999.579237] env[77391]: DEBUG oslo_concurrency.lockutils [None req-42a48744-b396-4538-87e0-9e0eebc40f5c None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  999.579360] env[77391]: DEBUG oslo_concurrency.lockutils [None req-42a48744-b396-4538-87e0-9e0eebc40f5c None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  999.579718] env[77391]: DEBUG oslo_concurrency.lockutils [None req-42a48744-b396-4538-87e0-9e0eebc40f5c None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  999.588892] env[77391]: DEBUG oslo_concurrency.lockutils [None req-42a48744-b396-4538-87e0-9e0eebc40f5c None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  999.589137] env[77391]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-42a48744-b396-4538-87e0-9e0eebc40f5c None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  999.589284] env[77391]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-42a48744-b396-4538-87e0-9e0eebc40f5c None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=77391) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[ 1001.595436] env[77391]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-42a48744-b396-4538-87e0-9e0eebc40f5c None None] Session token - acquiring
[ 1001.595858] env[77391]: DEBUG networking_nsxv3.common.locking [None req-42a48744-b396-4538-87e0-9e0eebc40f5c None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=77391) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[ 1001.596383] env[77391]: DEBUG oslo_concurrency.lockutils [None req-42a48744-b396-4538-87e0-9e0eebc40f5c None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[ 1001.596383] env[77391]: DEBUG oslo_concurrency.lockutils [None req-42a48744-b396-4538-87e0-9e0eebc40f5c None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[ 1001.596545] env[77391]: DEBUG oslo_concurrency.lockutils [None req-42a48744-b396-4538-87e0-9e0eebc40f5c None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[ 1001.605929] env[77391]: DEBUG oslo_concurrency.lockutils [None req-42a48744-b396-4538-87e0-9e0eebc40f5c None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[ 1001.606165] env[77391]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-42a48744-b396-4538-87e0-9e0eebc40f5c None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[ 1001.606310] env[77391]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-42a48744-b396-4538-87e0-9e0eebc40f5c None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=77391) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[ 1003.608614] env[77391]: CRITICAL neutron [None req-42a48744-b396-4538-87e0-9e0eebc40f5c None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[ 1003.608614] env[77391]: ERROR neutron Traceback (most recent call last):
[ 1003.608614] env[77391]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[ 1003.608614] env[77391]: ERROR neutron     sys.exit(main())
[ 1003.608614] env[77391]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[ 1003.608614] env[77391]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[ 1003.608614] env[77391]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[ 1003.608614] env[77391]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[ 1003.608614] env[77391]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[ 1003.608614] env[77391]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[ 1003.608614] env[77391]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[ 1003.608614] env[77391]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[ 1003.608614] env[77391]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[ 1003.608614] env[77391]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[ 1003.608614] env[77391]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[ 1003.608614] env[77391]: ERROR neutron     response = self.get(path=path, params=params)
[ 1003.609763] env[77391]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[ 1003.609763] env[77391]: ERROR neutron     raise RuntimeError(msg, last_err)
[ 1003.609763] env[77391]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[ 1003.609763] env[77391]: ERROR neutron 
[ 1006.076768] env[77398]: INFO neutron.common.config [-] Logging enabled!
[ 1006.077228] env[77398]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[ 1006.077377] env[77398]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=77398) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[ 1006.077620] env[77398]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[ 1006.077714] env[77398]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[ 1006.078598] env[77398]: WARNING oslo_policy.policy [None req-e81f9f21-8001-4e2c-b325-0d668c9fc990 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[ 1006.078833] env[77398]: WARNING oslo_policy.policy [None req-e81f9f21-8001-4e2c-b325-0d668c9fc990 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[ 1006.080265] env[77398]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-e81f9f21-8001-4e2c-b325-0d668c9fc990 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[ 1006.094422] env[77398]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e81f9f21-8001-4e2c-b325-0d668c9fc990 None None] Session token - acquiring
[ 1006.095190] env[77398]: DEBUG networking_nsxv3.common.locking [None req-e81f9f21-8001-4e2c-b325-0d668c9fc990 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=77398) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[ 1006.095390] env[77398]: DEBUG oslo_concurrency.lockutils [None req-e81f9f21-8001-4e2c-b325-0d668c9fc990 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77398) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[ 1006.095516] env[77398]: DEBUG oslo_concurrency.lockutils [None req-e81f9f21-8001-4e2c-b325-0d668c9fc990 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77398) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[ 1006.095868] env[77398]: DEBUG oslo_concurrency.lockutils [None req-e81f9f21-8001-4e2c-b325-0d668c9fc990 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77398) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[ 1006.105201] env[77398]: DEBUG oslo_concurrency.lockutils [None req-e81f9f21-8001-4e2c-b325-0d668c9fc990 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77398) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[ 1006.105438] env[77398]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e81f9f21-8001-4e2c-b325-0d668c9fc990 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[ 1006.105577] env[77398]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e81f9f21-8001-4e2c-b325-0d668c9fc990 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=77398) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[ 1008.111527] env[77398]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e81f9f21-8001-4e2c-b325-0d668c9fc990 None None] Session token - acquiring
[ 1008.112038] env[77398]: DEBUG networking_nsxv3.common.locking [None req-e81f9f21-8001-4e2c-b325-0d668c9fc990 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=77398) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[ 1008.112038] env[77398]: DEBUG oslo_concurrency.lockutils [None req-e81f9f21-8001-4e2c-b325-0d668c9fc990 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77398) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[ 1008.112216] env[77398]: DEBUG oslo_concurrency.lockutils [None req-e81f9f21-8001-4e2c-b325-0d668c9fc990 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77398) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[ 1008.112463] env[77398]: DEBUG oslo_concurrency.lockutils [None req-e81f9f21-8001-4e2c-b325-0d668c9fc990 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77398) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[ 1008.121210] env[77398]: DEBUG oslo_concurrency.lockutils [None req-e81f9f21-8001-4e2c-b325-0d668c9fc990 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77398) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[ 1008.121428] env[77398]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e81f9f21-8001-4e2c-b325-0d668c9fc990 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[ 1008.121571] env[77398]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e81f9f21-8001-4e2c-b325-0d668c9fc990 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=77398) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[ 1010.124537] env[77398]: CRITICAL neutron [None req-e81f9f21-8001-4e2c-b325-0d668c9fc990 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[ 1010.124537] env[77398]: ERROR neutron Traceback (most recent call last):
[ 1010.124537] env[77398]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[ 1010.124537] env[77398]: ERROR neutron     sys.exit(main())
[ 1010.124537] env[77398]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[ 1010.124537] env[77398]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[ 1010.124537] env[77398]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[ 1010.124537] env[77398]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[ 1010.124537] env[77398]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[ 1010.124537] env[77398]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[ 1010.124537] env[77398]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[ 1010.124537] env[77398]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[ 1010.124537] env[77398]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[ 1010.124537] env[77398]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[ 1010.124537] env[77398]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[ 1010.124537] env[77398]: ERROR neutron     response = self.get(path=path, params=params)
[ 1010.125268] env[77398]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[ 1010.125268] env[77398]: ERROR neutron     raise RuntimeError(msg, last_err)
[ 1010.125268] env[77398]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[ 1010.125268] env[77398]: ERROR neutron 
[ 1012.566869] env[77425]: INFO neutron.common.config [-] Logging enabled!
[ 1012.567284] env[77425]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[ 1012.567417] env[77425]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=77425) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[ 1012.567581] env[77425]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[ 1012.567673] env[77425]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[ 1012.568507] env[77425]: WARNING oslo_policy.policy [None req-c2f44846-78c7-4751-ab09-2616af999fd2 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[ 1012.568729] env[77425]: WARNING oslo_policy.policy [None req-c2f44846-78c7-4751-ab09-2616af999fd2 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[ 1012.569861] env[77425]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-c2f44846-78c7-4751-ab09-2616af999fd2 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[ 1012.583743] env[77425]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-c2f44846-78c7-4751-ab09-2616af999fd2 None None] Session token - acquiring
[ 1012.584485] env[77425]: DEBUG networking_nsxv3.common.locking [None req-c2f44846-78c7-4751-ab09-2616af999fd2 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=77425) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[ 1012.584697] env[77425]: DEBUG oslo_concurrency.lockutils [None req-c2f44846-78c7-4751-ab09-2616af999fd2 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77425) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[ 1012.584825] env[77425]: DEBUG oslo_concurrency.lockutils [None req-c2f44846-78c7-4751-ab09-2616af999fd2 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77425) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[ 1012.585177] env[77425]: DEBUG oslo_concurrency.lockutils [None req-c2f44846-78c7-4751-ab09-2616af999fd2 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77425) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[ 1012.594063] env[77425]: DEBUG oslo_concurrency.lockutils [None req-c2f44846-78c7-4751-ab09-2616af999fd2 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77425) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[ 1012.594337] env[77425]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-c2f44846-78c7-4751-ab09-2616af999fd2 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[ 1012.594496] env[77425]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-c2f44846-78c7-4751-ab09-2616af999fd2 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=77425) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[ 1014.600620] env[77425]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-c2f44846-78c7-4751-ab09-2616af999fd2 None None] Session token - acquiring
[ 1014.601013] env[77425]: DEBUG networking_nsxv3.common.locking [None req-c2f44846-78c7-4751-ab09-2616af999fd2 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=77425) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[ 1014.601180] env[77425]: DEBUG oslo_concurrency.lockutils [None req-c2f44846-78c7-4751-ab09-2616af999fd2 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77425) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[ 1014.601319] env[77425]: DEBUG oslo_concurrency.lockutils [None req-c2f44846-78c7-4751-ab09-2616af999fd2 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77425) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[ 1014.601599] env[77425]: DEBUG oslo_concurrency.lockutils [None req-c2f44846-78c7-4751-ab09-2616af999fd2 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77425) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[ 1014.610497] env[77425]: DEBUG oslo_concurrency.lockutils [None req-c2f44846-78c7-4751-ab09-2616af999fd2 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77425) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[ 1014.610726] env[77425]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-c2f44846-78c7-4751-ab09-2616af999fd2 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[ 1014.610866] env[77425]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-c2f44846-78c7-4751-ab09-2616af999fd2 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=77425) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[ 1016.612910] env[77425]: CRITICAL neutron [None req-c2f44846-78c7-4751-ab09-2616af999fd2 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[ 1016.612910] env[77425]: ERROR neutron Traceback (most recent call last):
[ 1016.612910] env[77425]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[ 1016.612910] env[77425]: ERROR neutron     sys.exit(main())
[ 1016.612910] env[77425]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[ 1016.612910] env[77425]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[ 1016.612910] env[77425]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[ 1016.612910] env[77425]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[ 1016.612910] env[77425]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[ 1016.612910] env[77425]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[ 1016.612910] env[77425]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[ 1016.612910] env[77425]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[ 1016.612910] env[77425]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[ 1016.612910] env[77425]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[ 1016.612910] env[77425]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[ 1016.612910] env[77425]: ERROR neutron     response = self.get(path=path, params=params)
[ 1016.613545] env[77425]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[ 1016.613545] env[77425]: ERROR neutron     raise RuntimeError(msg, last_err)
[ 1016.613545] env[77425]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[ 1016.613545] env[77425]: ERROR neutron 
[ 1019.061847] env[77474]: INFO neutron.common.config [-] Logging enabled!
[ 1019.062365] env[77474]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[ 1019.062365] env[77474]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=77474) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[ 1019.062533] env[77474]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[ 1019.062629] env[77474]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[ 1019.063451] env[77474]: WARNING oslo_policy.policy [None req-74f63244-bef8-4edd-8bef-05e5eb2bf63a None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[ 1019.063670] env[77474]: WARNING oslo_policy.policy [None req-74f63244-bef8-4edd-8bef-05e5eb2bf63a None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[ 1019.064871] env[77474]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-74f63244-bef8-4edd-8bef-05e5eb2bf63a None None] Looking for TransportZone with name nsx-vlan-transportzone.
[ 1019.078872] env[77474]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-74f63244-bef8-4edd-8bef-05e5eb2bf63a None None] Session token - acquiring
[ 1019.079623] env[77474]: DEBUG networking_nsxv3.common.locking [None req-74f63244-bef8-4edd-8bef-05e5eb2bf63a None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=77474) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[ 1019.079821] env[77474]: DEBUG oslo_concurrency.lockutils [None req-74f63244-bef8-4edd-8bef-05e5eb2bf63a None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77474) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[ 1019.079948] env[77474]: DEBUG oslo_concurrency.lockutils [None req-74f63244-bef8-4edd-8bef-05e5eb2bf63a None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77474) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[ 1019.080365] env[77474]: DEBUG oslo_concurrency.lockutils [None req-74f63244-bef8-4edd-8bef-05e5eb2bf63a None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77474) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[ 1019.088940] env[77474]: DEBUG oslo_concurrency.lockutils [None req-74f63244-bef8-4edd-8bef-05e5eb2bf63a None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77474) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[ 1019.089176] env[77474]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-74f63244-bef8-4edd-8bef-05e5eb2bf63a None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[ 1019.089323] env[77474]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-74f63244-bef8-4edd-8bef-05e5eb2bf63a None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=77474) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[ 1021.095730] env[77474]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-74f63244-bef8-4edd-8bef-05e5eb2bf63a None None] Session token - acquiring
[ 1021.095730] env[77474]: DEBUG networking_nsxv3.common.locking [None req-74f63244-bef8-4edd-8bef-05e5eb2bf63a None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=77474) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[ 1021.097037] env[77474]: DEBUG oslo_concurrency.lockutils [None req-74f63244-bef8-4edd-8bef-05e5eb2bf63a None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77474) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[ 1021.097037] env[77474]: DEBUG oslo_concurrency.lockutils [None req-74f63244-bef8-4edd-8bef-05e5eb2bf63a None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77474) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[ 1021.097037] env[77474]: DEBUG oslo_concurrency.lockutils [None req-74f63244-bef8-4edd-8bef-05e5eb2bf63a None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77474) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[ 1021.105620] env[77474]: DEBUG oslo_concurrency.lockutils [None req-74f63244-bef8-4edd-8bef-05e5eb2bf63a None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77474) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[ 1021.105620] env[77474]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-74f63244-bef8-4edd-8bef-05e5eb2bf63a None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[ 1021.105778] env[77474]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-74f63244-bef8-4edd-8bef-05e5eb2bf63a None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=77474) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[ 1023.108761] env[77474]: CRITICAL neutron [None req-74f63244-bef8-4edd-8bef-05e5eb2bf63a None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[ 1023.108761] env[77474]: ERROR neutron Traceback (most recent call last):
[ 1023.108761] env[77474]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[ 1023.108761] env[77474]: ERROR neutron     sys.exit(main())
[ 1023.108761] env[77474]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[ 1023.108761] env[77474]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[ 1023.108761] env[77474]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[ 1023.108761] env[77474]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[ 1023.108761] env[77474]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[ 1023.108761] env[77474]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[ 1023.108761] env[77474]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[ 1023.108761] env[77474]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[ 1023.108761] env[77474]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[ 1023.108761] env[77474]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[ 1023.108761] env[77474]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[ 1023.108761] env[77474]: ERROR neutron     response = self.get(path=path, params=params)
[ 1023.109703] env[77474]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[ 1023.109703] env[77474]: ERROR neutron     raise RuntimeError(msg, last_err)
[ 1023.109703] env[77474]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[ 1023.109703] env[77474]: ERROR neutron 
[ 1025.544186] env[77481]: INFO neutron.common.config [-] Logging enabled!
[ 1025.544612] env[77481]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[ 1025.544713] env[77481]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=77481) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[ 1025.544898] env[77481]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[ 1025.544989] env[77481]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[ 1025.545795] env[77481]: WARNING oslo_policy.policy [None req-076fc6f3-9f70-485b-9a94-856d7f3a4276 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[ 1025.546018] env[77481]: WARNING oslo_policy.policy [None req-076fc6f3-9f70-485b-9a94-856d7f3a4276 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[ 1025.547162] env[77481]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-076fc6f3-9f70-485b-9a94-856d7f3a4276 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[ 1025.561095] env[77481]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-076fc6f3-9f70-485b-9a94-856d7f3a4276 None None] Session token - acquiring
[ 1025.561814] env[77481]: DEBUG networking_nsxv3.common.locking [None req-076fc6f3-9f70-485b-9a94-856d7f3a4276 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=77481) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[ 1025.562009] env[77481]: DEBUG oslo_concurrency.lockutils [None req-076fc6f3-9f70-485b-9a94-856d7f3a4276 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77481) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[ 1025.562139] env[77481]: DEBUG oslo_concurrency.lockutils [None req-076fc6f3-9f70-485b-9a94-856d7f3a4276 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77481) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[ 1025.562485] env[77481]: DEBUG oslo_concurrency.lockutils [None req-076fc6f3-9f70-485b-9a94-856d7f3a4276 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77481) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[ 1025.570906] env[77481]: DEBUG oslo_concurrency.lockutils [None req-076fc6f3-9f70-485b-9a94-856d7f3a4276 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77481) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[ 1025.571176] env[77481]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-076fc6f3-9f70-485b-9a94-856d7f3a4276 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[ 1025.571322] env[77481]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-076fc6f3-9f70-485b-9a94-856d7f3a4276 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=77481) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[ 1027.577589] env[77481]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-076fc6f3-9f70-485b-9a94-856d7f3a4276 None None] Session token - acquiring
[ 1027.577949] env[77481]: DEBUG networking_nsxv3.common.locking [None req-076fc6f3-9f70-485b-9a94-856d7f3a4276 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=77481) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[ 1027.578088] env[77481]: DEBUG oslo_concurrency.lockutils [None req-076fc6f3-9f70-485b-9a94-856d7f3a4276 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77481) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[ 1027.578218] env[77481]: DEBUG oslo_concurrency.lockutils [None req-076fc6f3-9f70-485b-9a94-856d7f3a4276 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77481) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[ 1027.578628] env[77481]: DEBUG oslo_concurrency.lockutils [None req-076fc6f3-9f70-485b-9a94-856d7f3a4276 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77481) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[ 1027.587591] env[77481]: DEBUG oslo_concurrency.lockutils [None req-076fc6f3-9f70-485b-9a94-856d7f3a4276 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77481) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[ 1027.587817] env[77481]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-076fc6f3-9f70-485b-9a94-856d7f3a4276 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[ 1027.587975] env[77481]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-076fc6f3-9f70-485b-9a94-856d7f3a4276 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=77481) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[ 1029.590984] env[77481]: CRITICAL neutron [None req-076fc6f3-9f70-485b-9a94-856d7f3a4276 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[ 1029.590984] env[77481]: ERROR neutron Traceback (most recent call last):
[ 1029.590984] env[77481]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[ 1029.590984] env[77481]: ERROR neutron     sys.exit(main())
[ 1029.590984] env[77481]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[ 1029.590984] env[77481]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[ 1029.590984] env[77481]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[ 1029.590984] env[77481]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[ 1029.590984] env[77481]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[ 1029.590984] env[77481]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[ 1029.590984] env[77481]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[ 1029.590984] env[77481]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[ 1029.590984] env[77481]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[ 1029.590984] env[77481]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[ 1029.590984] env[77481]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[ 1029.590984] env[77481]: ERROR neutron     response = self.get(path=path, params=params)
[ 1029.591833] env[77481]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[ 1029.591833] env[77481]: ERROR neutron     raise RuntimeError(msg, last_err)
[ 1029.591833] env[77481]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[ 1029.591833] env[77481]: ERROR neutron 
[ 1032.047229] env[77487]: INFO neutron.common.config [-] Logging enabled!
[ 1032.047665] env[77487]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 25.0.0.0b2.dev63
[ 1032.047665] env[77487]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=77487) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[ 1032.047902] env[77487]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[ 1032.048016] env[77487]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[ 1032.048846] env[77487]: WARNING oslo_policy.policy [None req-ff7c8f4d-9162-40ed-a32c-36e0dff51a0d None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[ 1032.049070] env[77487]: WARNING oslo_policy.policy [None req-ff7c8f4d-9162-40ed-a32c-36e0dff51a0d None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[ 1032.050262] env[77487]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-ff7c8f4d-9162-40ed-a32c-36e0dff51a0d None None] Looking for TransportZone with name nsx-vlan-transportzone.
[ 1032.064373] env[77487]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ff7c8f4d-9162-40ed-a32c-36e0dff51a0d None None] Session token - acquiring
[ 1032.065143] env[77487]: DEBUG networking_nsxv3.common.locking [None req-ff7c8f4d-9162-40ed-a32c-36e0dff51a0d None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=77487) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[ 1032.065348] env[77487]: DEBUG oslo_concurrency.lockutils [None req-ff7c8f4d-9162-40ed-a32c-36e0dff51a0d None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77487) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[ 1032.065475] env[77487]: DEBUG oslo_concurrency.lockutils [None req-ff7c8f4d-9162-40ed-a32c-36e0dff51a0d None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77487) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[ 1032.065827] env[77487]: DEBUG oslo_concurrency.lockutils [None req-ff7c8f4d-9162-40ed-a32c-36e0dff51a0d None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77487) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[ 1032.074526] env[77487]: DEBUG oslo_concurrency.lockutils [None req-ff7c8f4d-9162-40ed-a32c-36e0dff51a0d None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77487) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[ 1032.074762] env[77487]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ff7c8f4d-9162-40ed-a32c-36e0dff51a0d None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[ 1032.074907] env[77487]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ff7c8f4d-9162-40ed-a32c-36e0dff51a0d None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=77487) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[ 1034.081174] env[77487]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ff7c8f4d-9162-40ed-a32c-36e0dff51a0d None None] Session token - acquiring
[ 1034.081519] env[77487]: DEBUG networking_nsxv3.common.locking [None req-ff7c8f4d-9162-40ed-a32c-36e0dff51a0d None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=77487) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[ 1034.081761] env[77487]: DEBUG oslo_concurrency.lockutils [None req-ff7c8f4d-9162-40ed-a32c-36e0dff51a0d None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77487) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[ 1034.081901] env[77487]: DEBUG oslo_concurrency.lockutils [None req-ff7c8f4d-9162-40ed-a32c-36e0dff51a0d None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77487) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[ 1034.082173] env[77487]: DEBUG oslo_concurrency.lockutils [None req-ff7c8f4d-9162-40ed-a32c-36e0dff51a0d None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77487) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[ 1034.091103] env[77487]: DEBUG oslo_concurrency.lockutils [None req-ff7c8f4d-9162-40ed-a32c-36e0dff51a0d None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77487) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[ 1034.091348] env[77487]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ff7c8f4d-9162-40ed-a32c-36e0dff51a0d None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[ 1034.091490] env[77487]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ff7c8f4d-9162-40ed-a32c-36e0dff51a0d None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=77487) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[ 1036.094479] env[77487]: CRITICAL neutron [None req-ff7c8f4d-9162-40ed-a32c-36e0dff51a0d None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[ 1036.094479] env[77487]: ERROR neutron Traceback (most recent call last):
[ 1036.094479] env[77487]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[ 1036.094479] env[77487]: ERROR neutron     sys.exit(main())
[ 1036.094479] env[77487]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[ 1036.094479] env[77487]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[ 1036.094479] env[77487]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[ 1036.094479] env[77487]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[ 1036.094479] env[77487]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[ 1036.094479] env[77487]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[ 1036.094479] env[77487]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[ 1036.094479] env[77487]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[ 1036.094479] env[77487]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[ 1036.094479] env[77487]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[ 1036.094479] env[77487]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[ 1036.094479] env[77487]: ERROR neutron     response = self.get(path=path, params=params)
[ 1036.095481] env[77487]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[ 1036.095481] env[77487]: ERROR neutron     raise RuntimeError(msg, last_err)
[ 1036.095481] env[77487]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[ 1036.095481] env[77487]: ERROR neutron