[  465.462893] env[62196]: INFO neutron.common.config [-] Logging enabled!
[  465.463433] env[62196]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  465.463433] env[62196]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=62196) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  465.463595] env[62196]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  465.463692] env[62196]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  465.464516] env[62196]: WARNING oslo_policy.policy [None req-d8b794d4-3563-4d42-bfe2-a55525c7fbab None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  465.464740] env[62196]: WARNING oslo_policy.policy [None req-d8b794d4-3563-4d42-bfe2-a55525c7fbab None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  465.465947] env[62196]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-d8b794d4-3563-4d42-bfe2-a55525c7fbab None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  465.487368] env[62196]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-d8b794d4-3563-4d42-bfe2-a55525c7fbab None None] Session token - acquiring
[  465.488182] env[62196]: DEBUG networking_nsxv3.common.locking [None req-d8b794d4-3563-4d42-bfe2-a55525c7fbab None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62196) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  465.488383] env[62196]: DEBUG oslo_concurrency.lockutils [None req-d8b794d4-3563-4d42-bfe2-a55525c7fbab None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62196) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  465.488513] env[62196]: DEBUG oslo_concurrency.lockutils [None req-d8b794d4-3563-4d42-bfe2-a55525c7fbab None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62196) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  465.488900] env[62196]: DEBUG oslo_concurrency.lockutils [None req-d8b794d4-3563-4d42-bfe2-a55525c7fbab None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62196) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  465.499234] env[62196]: DEBUG oslo_concurrency.lockutils [None req-d8b794d4-3563-4d42-bfe2-a55525c7fbab None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62196) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  465.499480] env[62196]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-d8b794d4-3563-4d42-bfe2-a55525c7fbab None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  465.499625] env[62196]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-d8b794d4-3563-4d42-bfe2-a55525c7fbab None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=62196) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  467.506399] env[62196]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-d8b794d4-3563-4d42-bfe2-a55525c7fbab None None] Session token - acquiring
[  467.506753] env[62196]: DEBUG networking_nsxv3.common.locking [None req-d8b794d4-3563-4d42-bfe2-a55525c7fbab None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62196) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  467.506949] env[62196]: DEBUG oslo_concurrency.lockutils [None req-d8b794d4-3563-4d42-bfe2-a55525c7fbab None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62196) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  467.507038] env[62196]: DEBUG oslo_concurrency.lockutils [None req-d8b794d4-3563-4d42-bfe2-a55525c7fbab None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62196) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  467.507318] env[62196]: DEBUG oslo_concurrency.lockutils [None req-d8b794d4-3563-4d42-bfe2-a55525c7fbab None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62196) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  467.517136] env[62196]: DEBUG oslo_concurrency.lockutils [None req-d8b794d4-3563-4d42-bfe2-a55525c7fbab None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62196) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  467.517367] env[62196]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-d8b794d4-3563-4d42-bfe2-a55525c7fbab None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  467.517508] env[62196]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-d8b794d4-3563-4d42-bfe2-a55525c7fbab None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=62196) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  469.520497] env[62196]: CRITICAL neutron [None req-d8b794d4-3563-4d42-bfe2-a55525c7fbab None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  469.520497] env[62196]: ERROR neutron Traceback (most recent call last):
[  469.520497] env[62196]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  469.520497] env[62196]: ERROR neutron     sys.exit(main())
[  469.520497] env[62196]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  469.520497] env[62196]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  469.520497] env[62196]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  469.520497] env[62196]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  469.520497] env[62196]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  469.520497] env[62196]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  469.520497] env[62196]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  469.520497] env[62196]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  469.520497] env[62196]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  469.520497] env[62196]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  469.520497] env[62196]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  469.520497] env[62196]: ERROR neutron     response = self.get(path=path, params=params)
[  469.521293] env[62196]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  469.521293] env[62196]: ERROR neutron     raise RuntimeError(msg, last_err)
[  469.521293] env[62196]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  469.521293] env[62196]: ERROR neutron 
[  471.906622] env[62228]: INFO neutron.common.config [-] Logging enabled!
[  471.907060] env[62228]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  471.907248] env[62228]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=62228) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  471.907511] env[62228]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  471.907640] env[62228]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  471.908532] env[62228]: WARNING oslo_policy.policy [None req-db1489b9-e670-4782-aa9a-b0cb324e4895 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  471.908808] env[62228]: WARNING oslo_policy.policy [None req-db1489b9-e670-4782-aa9a-b0cb324e4895 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  471.910114] env[62228]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-db1489b9-e670-4782-aa9a-b0cb324e4895 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  471.925247] env[62228]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-db1489b9-e670-4782-aa9a-b0cb324e4895 None None] Session token - acquiring
[  471.926055] env[62228]: DEBUG networking_nsxv3.common.locking [None req-db1489b9-e670-4782-aa9a-b0cb324e4895 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62228) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  471.926303] env[62228]: DEBUG oslo_concurrency.lockutils [None req-db1489b9-e670-4782-aa9a-b0cb324e4895 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62228) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  471.926471] env[62228]: DEBUG oslo_concurrency.lockutils [None req-db1489b9-e670-4782-aa9a-b0cb324e4895 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62228) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  471.926869] env[62228]: DEBUG oslo_concurrency.lockutils [None req-db1489b9-e670-4782-aa9a-b0cb324e4895 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62228) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  471.936929] env[62228]: DEBUG oslo_concurrency.lockutils [None req-db1489b9-e670-4782-aa9a-b0cb324e4895 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62228) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  471.937228] env[62228]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-db1489b9-e670-4782-aa9a-b0cb324e4895 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  471.937424] env[62228]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-db1489b9-e670-4782-aa9a-b0cb324e4895 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=62228) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  473.945683] env[62228]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-db1489b9-e670-4782-aa9a-b0cb324e4895 None None] Session token - acquiring
[  473.946155] env[62228]: DEBUG networking_nsxv3.common.locking [None req-db1489b9-e670-4782-aa9a-b0cb324e4895 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62228) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  473.946356] env[62228]: DEBUG oslo_concurrency.lockutils [None req-db1489b9-e670-4782-aa9a-b0cb324e4895 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62228) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  473.946491] env[62228]: DEBUG oslo_concurrency.lockutils [None req-db1489b9-e670-4782-aa9a-b0cb324e4895 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62228) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  473.946750] env[62228]: DEBUG oslo_concurrency.lockutils [None req-db1489b9-e670-4782-aa9a-b0cb324e4895 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62228) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  473.956149] env[62228]: DEBUG oslo_concurrency.lockutils [None req-db1489b9-e670-4782-aa9a-b0cb324e4895 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62228) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  473.956393] env[62228]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-db1489b9-e670-4782-aa9a-b0cb324e4895 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  473.956534] env[62228]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-db1489b9-e670-4782-aa9a-b0cb324e4895 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=62228) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  475.959466] env[62228]: CRITICAL neutron [None req-db1489b9-e670-4782-aa9a-b0cb324e4895 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  475.959466] env[62228]: ERROR neutron Traceback (most recent call last):
[  475.959466] env[62228]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  475.959466] env[62228]: ERROR neutron     sys.exit(main())
[  475.959466] env[62228]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  475.959466] env[62228]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  475.959466] env[62228]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  475.959466] env[62228]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  475.959466] env[62228]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  475.959466] env[62228]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  475.959466] env[62228]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  475.959466] env[62228]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  475.959466] env[62228]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  475.959466] env[62228]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  475.959466] env[62228]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  475.959466] env[62228]: ERROR neutron     response = self.get(path=path, params=params)
[  475.960489] env[62228]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  475.960489] env[62228]: ERROR neutron     raise RuntimeError(msg, last_err)
[  475.960489] env[62228]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  475.960489] env[62228]: ERROR neutron 
[  478.406503] env[62251]: INFO neutron.common.config [-] Logging enabled!
[  478.406864] env[62251]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  478.407005] env[62251]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=62251) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  478.407232] env[62251]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  478.407326] env[62251]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  478.408163] env[62251]: WARNING oslo_policy.policy [None req-c7d2b138-6218-45f9-9e9e-3e4e65ab95b0 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  478.408391] env[62251]: WARNING oslo_policy.policy [None req-c7d2b138-6218-45f9-9e9e-3e4e65ab95b0 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  478.409593] env[62251]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-c7d2b138-6218-45f9-9e9e-3e4e65ab95b0 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  478.424163] env[62251]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-c7d2b138-6218-45f9-9e9e-3e4e65ab95b0 None None] Session token - acquiring
[  478.424933] env[62251]: DEBUG networking_nsxv3.common.locking [None req-c7d2b138-6218-45f9-9e9e-3e4e65ab95b0 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62251) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  478.425130] env[62251]: DEBUG oslo_concurrency.lockutils [None req-c7d2b138-6218-45f9-9e9e-3e4e65ab95b0 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62251) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  478.425257] env[62251]: DEBUG oslo_concurrency.lockutils [None req-c7d2b138-6218-45f9-9e9e-3e4e65ab95b0 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62251) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  478.425609] env[62251]: DEBUG oslo_concurrency.lockutils [None req-c7d2b138-6218-45f9-9e9e-3e4e65ab95b0 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62251) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  478.434219] env[62251]: DEBUG oslo_concurrency.lockutils [None req-c7d2b138-6218-45f9-9e9e-3e4e65ab95b0 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62251) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  478.434463] env[62251]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-c7d2b138-6218-45f9-9e9e-3e4e65ab95b0 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  478.434612] env[62251]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-c7d2b138-6218-45f9-9e9e-3e4e65ab95b0 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=62251) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  480.440657] env[62251]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-c7d2b138-6218-45f9-9e9e-3e4e65ab95b0 None None] Session token - acquiring
[  480.441045] env[62251]: DEBUG networking_nsxv3.common.locking [None req-c7d2b138-6218-45f9-9e9e-3e4e65ab95b0 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62251) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  480.441253] env[62251]: DEBUG oslo_concurrency.lockutils [None req-c7d2b138-6218-45f9-9e9e-3e4e65ab95b0 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62251) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  480.441381] env[62251]: DEBUG oslo_concurrency.lockutils [None req-c7d2b138-6218-45f9-9e9e-3e4e65ab95b0 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62251) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  480.441653] env[62251]: DEBUG oslo_concurrency.lockutils [None req-c7d2b138-6218-45f9-9e9e-3e4e65ab95b0 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62251) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  480.450904] env[62251]: DEBUG oslo_concurrency.lockutils [None req-c7d2b138-6218-45f9-9e9e-3e4e65ab95b0 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62251) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  480.451139] env[62251]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-c7d2b138-6218-45f9-9e9e-3e4e65ab95b0 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  480.451276] env[62251]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-c7d2b138-6218-45f9-9e9e-3e4e65ab95b0 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=62251) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  482.452932] env[62251]: CRITICAL neutron [None req-c7d2b138-6218-45f9-9e9e-3e4e65ab95b0 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  482.452932] env[62251]: ERROR neutron Traceback (most recent call last):
[  482.452932] env[62251]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  482.452932] env[62251]: ERROR neutron     sys.exit(main())
[  482.452932] env[62251]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  482.452932] env[62251]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  482.452932] env[62251]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  482.452932] env[62251]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  482.452932] env[62251]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  482.452932] env[62251]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  482.452932] env[62251]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  482.452932] env[62251]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  482.452932] env[62251]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  482.452932] env[62251]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  482.452932] env[62251]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  482.452932] env[62251]: ERROR neutron     response = self.get(path=path, params=params)
[  482.453837] env[62251]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  482.453837] env[62251]: ERROR neutron     raise RuntimeError(msg, last_err)
[  482.453837] env[62251]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  482.453837] env[62251]: ERROR neutron 
[  484.886094] env[62298]: INFO neutron.common.config [-] Logging enabled!
[  484.886453] env[62298]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  484.886644] env[62298]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=62298) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  484.886876] env[62298]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  484.886981] env[62298]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  484.887861] env[62298]: WARNING oslo_policy.policy [None req-b70f7534-e1e1-481c-9bc7-a441eb28c94c None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  484.888127] env[62298]: WARNING oslo_policy.policy [None req-b70f7534-e1e1-481c-9bc7-a441eb28c94c None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  484.889292] env[62298]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-b70f7534-e1e1-481c-9bc7-a441eb28c94c None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  484.903267] env[62298]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-b70f7534-e1e1-481c-9bc7-a441eb28c94c None None] Session token - acquiring
[  484.904022] env[62298]: DEBUG networking_nsxv3.common.locking [None req-b70f7534-e1e1-481c-9bc7-a441eb28c94c None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62298) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  484.904222] env[62298]: DEBUG oslo_concurrency.lockutils [None req-b70f7534-e1e1-481c-9bc7-a441eb28c94c None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62298) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  484.904349] env[62298]: DEBUG oslo_concurrency.lockutils [None req-b70f7534-e1e1-481c-9bc7-a441eb28c94c None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62298) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  484.904702] env[62298]: DEBUG oslo_concurrency.lockutils [None req-b70f7534-e1e1-481c-9bc7-a441eb28c94c None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62298) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  484.913674] env[62298]: DEBUG oslo_concurrency.lockutils [None req-b70f7534-e1e1-481c-9bc7-a441eb28c94c None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62298) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  484.913911] env[62298]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-b70f7534-e1e1-481c-9bc7-a441eb28c94c None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  484.914324] env[62298]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-b70f7534-e1e1-481c-9bc7-a441eb28c94c None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=62298) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  486.919947] env[62298]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-b70f7534-e1e1-481c-9bc7-a441eb28c94c None None] Session token - acquiring
[  486.920259] env[62298]: DEBUG networking_nsxv3.common.locking [None req-b70f7534-e1e1-481c-9bc7-a441eb28c94c None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62298) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  486.920450] env[62298]: DEBUG oslo_concurrency.lockutils [None req-b70f7534-e1e1-481c-9bc7-a441eb28c94c None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62298) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  486.920573] env[62298]: DEBUG oslo_concurrency.lockutils [None req-b70f7534-e1e1-481c-9bc7-a441eb28c94c None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62298) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  486.920855] env[62298]: DEBUG oslo_concurrency.lockutils [None req-b70f7534-e1e1-481c-9bc7-a441eb28c94c None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62298) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  486.929607] env[62298]: DEBUG oslo_concurrency.lockutils [None req-b70f7534-e1e1-481c-9bc7-a441eb28c94c None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62298) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  486.929847] env[62298]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-b70f7534-e1e1-481c-9bc7-a441eb28c94c None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  486.929983] env[62298]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-b70f7534-e1e1-481c-9bc7-a441eb28c94c None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=62298) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  488.932897] env[62298]: CRITICAL neutron [None req-b70f7534-e1e1-481c-9bc7-a441eb28c94c None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  488.932897] env[62298]: ERROR neutron Traceback (most recent call last):
[  488.932897] env[62298]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  488.932897] env[62298]: ERROR neutron     sys.exit(main())
[  488.932897] env[62298]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  488.932897] env[62298]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  488.932897] env[62298]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  488.932897] env[62298]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  488.932897] env[62298]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  488.932897] env[62298]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  488.932897] env[62298]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  488.932897] env[62298]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  488.932897] env[62298]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  488.932897] env[62298]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  488.932897] env[62298]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  488.932897] env[62298]: ERROR neutron     response = self.get(path=path, params=params)
[  488.933542] env[62298]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  488.933542] env[62298]: ERROR neutron     raise RuntimeError(msg, last_err)
[  488.933542] env[62298]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  488.933542] env[62298]: ERROR neutron 
[  491.385243] env[62305]: INFO neutron.common.config [-] Logging enabled!
[  491.385639] env[62305]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  491.385736] env[62305]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=62305) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  491.385951] env[62305]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  491.386046] env[62305]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  491.386865] env[62305]: WARNING oslo_policy.policy [None req-f80ec816-7115-469e-b4f2-a0043895ce3d None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  491.387088] env[62305]: WARNING oslo_policy.policy [None req-f80ec816-7115-469e-b4f2-a0043895ce3d None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  491.388271] env[62305]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-f80ec816-7115-469e-b4f2-a0043895ce3d None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  491.402442] env[62305]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f80ec816-7115-469e-b4f2-a0043895ce3d None None] Session token - acquiring
[  491.403181] env[62305]: DEBUG networking_nsxv3.common.locking [None req-f80ec816-7115-469e-b4f2-a0043895ce3d None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62305) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  491.403388] env[62305]: DEBUG oslo_concurrency.lockutils [None req-f80ec816-7115-469e-b4f2-a0043895ce3d None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  491.403514] env[62305]: DEBUG oslo_concurrency.lockutils [None req-f80ec816-7115-469e-b4f2-a0043895ce3d None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  491.403873] env[62305]: DEBUG oslo_concurrency.lockutils [None req-f80ec816-7115-469e-b4f2-a0043895ce3d None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  491.412741] env[62305]: DEBUG oslo_concurrency.lockutils [None req-f80ec816-7115-469e-b4f2-a0043895ce3d None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  491.412982] env[62305]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f80ec816-7115-469e-b4f2-a0043895ce3d None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  491.413133] env[62305]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f80ec816-7115-469e-b4f2-a0043895ce3d None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=62305) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  493.419494] env[62305]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f80ec816-7115-469e-b4f2-a0043895ce3d None None] Session token - acquiring
[  493.419966] env[62305]: DEBUG networking_nsxv3.common.locking [None req-f80ec816-7115-469e-b4f2-a0043895ce3d None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62305) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  493.420156] env[62305]: DEBUG oslo_concurrency.lockutils [None req-f80ec816-7115-469e-b4f2-a0043895ce3d None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  493.420283] env[62305]: DEBUG oslo_concurrency.lockutils [None req-f80ec816-7115-469e-b4f2-a0043895ce3d None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  493.420558] env[62305]: DEBUG oslo_concurrency.lockutils [None req-f80ec816-7115-469e-b4f2-a0043895ce3d None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  493.429704] env[62305]: DEBUG oslo_concurrency.lockutils [None req-f80ec816-7115-469e-b4f2-a0043895ce3d None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  493.429964] env[62305]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f80ec816-7115-469e-b4f2-a0043895ce3d None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  493.430110] env[62305]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f80ec816-7115-469e-b4f2-a0043895ce3d None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=62305) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  495.432967] env[62305]: CRITICAL neutron [None req-f80ec816-7115-469e-b4f2-a0043895ce3d None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  495.432967] env[62305]: ERROR neutron Traceback (most recent call last):
[  495.432967] env[62305]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  495.432967] env[62305]: ERROR neutron     sys.exit(main())
[  495.432967] env[62305]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  495.432967] env[62305]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  495.432967] env[62305]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  495.432967] env[62305]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  495.432967] env[62305]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  495.432967] env[62305]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  495.432967] env[62305]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  495.432967] env[62305]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  495.432967] env[62305]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  495.432967] env[62305]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  495.432967] env[62305]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  495.432967] env[62305]: ERROR neutron     response = self.get(path=path, params=params)
[  495.433721] env[62305]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  495.433721] env[62305]: ERROR neutron     raise RuntimeError(msg, last_err)
[  495.433721] env[62305]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  495.433721] env[62305]: ERROR neutron 
[  497.921262] env[62357]: INFO neutron.common.config [-] Logging enabled!
[  497.921673] env[62357]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  497.921792] env[62357]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=62357) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  497.921973] env[62357]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  497.922070] env[62357]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  497.922882] env[62357]: WARNING oslo_policy.policy [None req-20643bac-a16d-4664-8b24-32acfaf2eb73 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  497.923099] env[62357]: WARNING oslo_policy.policy [None req-20643bac-a16d-4664-8b24-32acfaf2eb73 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  497.924282] env[62357]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-20643bac-a16d-4664-8b24-32acfaf2eb73 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  497.938586] env[62357]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-20643bac-a16d-4664-8b24-32acfaf2eb73 None None] Session token - acquiring
[  497.939385] env[62357]: DEBUG networking_nsxv3.common.locking [None req-20643bac-a16d-4664-8b24-32acfaf2eb73 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62357) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  497.939626] env[62357]: DEBUG oslo_concurrency.lockutils [None req-20643bac-a16d-4664-8b24-32acfaf2eb73 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62357) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  497.939784] env[62357]: DEBUG oslo_concurrency.lockutils [None req-20643bac-a16d-4664-8b24-32acfaf2eb73 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62357) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  497.940216] env[62357]: DEBUG oslo_concurrency.lockutils [None req-20643bac-a16d-4664-8b24-32acfaf2eb73 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62357) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  497.949064] env[62357]: DEBUG oslo_concurrency.lockutils [None req-20643bac-a16d-4664-8b24-32acfaf2eb73 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62357) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  497.949310] env[62357]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-20643bac-a16d-4664-8b24-32acfaf2eb73 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  497.949460] env[62357]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-20643bac-a16d-4664-8b24-32acfaf2eb73 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=62357) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  499.955607] env[62357]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-20643bac-a16d-4664-8b24-32acfaf2eb73 None None] Session token - acquiring
[  499.955968] env[62357]: DEBUG networking_nsxv3.common.locking [None req-20643bac-a16d-4664-8b24-32acfaf2eb73 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62357) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  499.956115] env[62357]: DEBUG oslo_concurrency.lockutils [None req-20643bac-a16d-4664-8b24-32acfaf2eb73 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62357) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  499.956239] env[62357]: DEBUG oslo_concurrency.lockutils [None req-20643bac-a16d-4664-8b24-32acfaf2eb73 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62357) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  499.956513] env[62357]: DEBUG oslo_concurrency.lockutils [None req-20643bac-a16d-4664-8b24-32acfaf2eb73 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62357) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  499.965387] env[62357]: DEBUG oslo_concurrency.lockutils [None req-20643bac-a16d-4664-8b24-32acfaf2eb73 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62357) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  499.965618] env[62357]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-20643bac-a16d-4664-8b24-32acfaf2eb73 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  499.965761] env[62357]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-20643bac-a16d-4664-8b24-32acfaf2eb73 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=62357) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  501.968676] env[62357]: CRITICAL neutron [None req-20643bac-a16d-4664-8b24-32acfaf2eb73 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  501.968676] env[62357]: ERROR neutron Traceback (most recent call last):
[  501.968676] env[62357]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  501.968676] env[62357]: ERROR neutron     sys.exit(main())
[  501.968676] env[62357]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  501.968676] env[62357]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  501.968676] env[62357]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  501.968676] env[62357]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  501.968676] env[62357]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  501.968676] env[62357]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  501.968676] env[62357]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  501.968676] env[62357]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  501.968676] env[62357]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  501.968676] env[62357]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  501.968676] env[62357]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  501.968676] env[62357]: ERROR neutron     response = self.get(path=path, params=params)
[  501.969777] env[62357]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  501.969777] env[62357]: ERROR neutron     raise RuntimeError(msg, last_err)
[  501.969777] env[62357]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  501.969777] env[62357]: ERROR neutron 
[  504.568369] env[62590]: INFO neutron.common.config [-] Logging enabled!
[  504.568683] env[62590]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  504.568901] env[62590]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=62590) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  504.569258] env[62590]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  504.569258] env[62590]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  504.570052] env[62590]: WARNING oslo_policy.policy [None req-02f713cd-1c7a-4317-bf26-1e5283a1b64b None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  504.570270] env[62590]: WARNING oslo_policy.policy [None req-02f713cd-1c7a-4317-bf26-1e5283a1b64b None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  504.571782] env[62590]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-02f713cd-1c7a-4317-bf26-1e5283a1b64b None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  504.586246] env[62590]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-02f713cd-1c7a-4317-bf26-1e5283a1b64b None None] Session token - acquiring
[  504.587088] env[62590]: DEBUG networking_nsxv3.common.locking [None req-02f713cd-1c7a-4317-bf26-1e5283a1b64b None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62590) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  504.587302] env[62590]: DEBUG oslo_concurrency.lockutils [None req-02f713cd-1c7a-4317-bf26-1e5283a1b64b None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  504.587431] env[62590]: DEBUG oslo_concurrency.lockutils [None req-02f713cd-1c7a-4317-bf26-1e5283a1b64b None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  504.587811] env[62590]: DEBUG oslo_concurrency.lockutils [None req-02f713cd-1c7a-4317-bf26-1e5283a1b64b None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  504.597013] env[62590]: DEBUG oslo_concurrency.lockutils [None req-02f713cd-1c7a-4317-bf26-1e5283a1b64b None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  504.597411] env[62590]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-02f713cd-1c7a-4317-bf26-1e5283a1b64b None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  504.597606] env[62590]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-02f713cd-1c7a-4317-bf26-1e5283a1b64b None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=62590) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  506.603652] env[62590]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-02f713cd-1c7a-4317-bf26-1e5283a1b64b None None] Session token - acquiring
[  506.603997] env[62590]: DEBUG networking_nsxv3.common.locking [None req-02f713cd-1c7a-4317-bf26-1e5283a1b64b None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62590) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  506.604211] env[62590]: DEBUG oslo_concurrency.lockutils [None req-02f713cd-1c7a-4317-bf26-1e5283a1b64b None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  506.604334] env[62590]: DEBUG oslo_concurrency.lockutils [None req-02f713cd-1c7a-4317-bf26-1e5283a1b64b None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  506.604645] env[62590]: DEBUG oslo_concurrency.lockutils [None req-02f713cd-1c7a-4317-bf26-1e5283a1b64b None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  506.614566] env[62590]: DEBUG oslo_concurrency.lockutils [None req-02f713cd-1c7a-4317-bf26-1e5283a1b64b None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  506.615115] env[62590]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-02f713cd-1c7a-4317-bf26-1e5283a1b64b None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  506.615402] env[62590]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-02f713cd-1c7a-4317-bf26-1e5283a1b64b None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=62590) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  508.616902] env[62590]: CRITICAL neutron [None req-02f713cd-1c7a-4317-bf26-1e5283a1b64b None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  508.616902] env[62590]: ERROR neutron Traceback (most recent call last):
[  508.616902] env[62590]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  508.616902] env[62590]: ERROR neutron     sys.exit(main())
[  508.616902] env[62590]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  508.616902] env[62590]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  508.616902] env[62590]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  508.616902] env[62590]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  508.616902] env[62590]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  508.616902] env[62590]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  508.616902] env[62590]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  508.616902] env[62590]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  508.616902] env[62590]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  508.616902] env[62590]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  508.616902] env[62590]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  508.616902] env[62590]: ERROR neutron     response = self.get(path=path, params=params)
[  508.617591] env[62590]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  508.617591] env[62590]: ERROR neutron     raise RuntimeError(msg, last_err)
[  508.617591] env[62590]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  508.617591] env[62590]: ERROR neutron 
[  511.453651] env[62704]: INFO neutron.common.config [-] Logging enabled!
[  511.453651] env[62704]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  511.453651] env[62704]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=62704) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  511.453651] env[62704]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  511.453651] env[62704]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  511.453651] env[62704]: WARNING oslo_policy.policy [None req-5a407c76-2a14-46ce-9b75-79c631d164c7 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  511.453651] env[62704]: WARNING oslo_policy.policy [None req-5a407c76-2a14-46ce-9b75-79c631d164c7 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  511.453651] env[62704]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-5a407c76-2a14-46ce-9b75-79c631d164c7 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  511.470407] env[62704]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5a407c76-2a14-46ce-9b75-79c631d164c7 None None] Session token - acquiring
[  511.471298] env[62704]: DEBUG networking_nsxv3.common.locking [None req-5a407c76-2a14-46ce-9b75-79c631d164c7 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62704) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  511.471507] env[62704]: DEBUG oslo_concurrency.lockutils [None req-5a407c76-2a14-46ce-9b75-79c631d164c7 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62704) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  511.471630] env[62704]: DEBUG oslo_concurrency.lockutils [None req-5a407c76-2a14-46ce-9b75-79c631d164c7 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62704) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  511.472265] env[62704]: DEBUG oslo_concurrency.lockutils [None req-5a407c76-2a14-46ce-9b75-79c631d164c7 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62704) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  511.482802] env[62704]: DEBUG oslo_concurrency.lockutils [None req-5a407c76-2a14-46ce-9b75-79c631d164c7 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62704) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  511.483085] env[62704]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5a407c76-2a14-46ce-9b75-79c631d164c7 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  511.483213] env[62704]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5a407c76-2a14-46ce-9b75-79c631d164c7 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=62704) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  513.490061] env[62704]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5a407c76-2a14-46ce-9b75-79c631d164c7 None None] Session token - acquiring
[  513.491100] env[62704]: DEBUG networking_nsxv3.common.locking [None req-5a407c76-2a14-46ce-9b75-79c631d164c7 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62704) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  513.491100] env[62704]: DEBUG oslo_concurrency.lockutils [None req-5a407c76-2a14-46ce-9b75-79c631d164c7 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62704) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  513.491286] env[62704]: DEBUG oslo_concurrency.lockutils [None req-5a407c76-2a14-46ce-9b75-79c631d164c7 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62704) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  513.491286] env[62704]: DEBUG oslo_concurrency.lockutils [None req-5a407c76-2a14-46ce-9b75-79c631d164c7 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62704) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  513.500383] env[62704]: DEBUG oslo_concurrency.lockutils [None req-5a407c76-2a14-46ce-9b75-79c631d164c7 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62704) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  513.500621] env[62704]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5a407c76-2a14-46ce-9b75-79c631d164c7 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  513.500758] env[62704]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5a407c76-2a14-46ce-9b75-79c631d164c7 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=62704) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  515.503730] env[62704]: CRITICAL neutron [None req-5a407c76-2a14-46ce-9b75-79c631d164c7 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  515.503730] env[62704]: ERROR neutron Traceback (most recent call last):
[  515.503730] env[62704]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  515.503730] env[62704]: ERROR neutron     sys.exit(main())
[  515.503730] env[62704]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  515.503730] env[62704]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  515.503730] env[62704]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  515.503730] env[62704]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  515.503730] env[62704]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  515.503730] env[62704]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  515.503730] env[62704]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  515.503730] env[62704]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  515.503730] env[62704]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  515.503730] env[62704]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  515.503730] env[62704]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  515.503730] env[62704]: ERROR neutron     response = self.get(path=path, params=params)
[  515.504513] env[62704]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  515.504513] env[62704]: ERROR neutron     raise RuntimeError(msg, last_err)
[  515.504513] env[62704]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  515.504513] env[62704]: ERROR neutron 
[  518.674865] env[63338]: INFO neutron.common.config [-] Logging enabled!
[  518.675108] env[63338]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  518.675448] env[63338]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=63338) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  518.675701] env[63338]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  518.675821] env[63338]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  518.676871] env[63338]: WARNING oslo_policy.policy [None req-be9ddcb7-914f-4fb9-b261-35bafb531df8 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  518.677607] env[63338]: WARNING oslo_policy.policy [None req-be9ddcb7-914f-4fb9-b261-35bafb531df8 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  518.678536] env[63338]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-be9ddcb7-914f-4fb9-b261-35bafb531df8 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  518.693717] env[63338]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-be9ddcb7-914f-4fb9-b261-35bafb531df8 None None] Session token - acquiring
[  518.694713] env[63338]: DEBUG networking_nsxv3.common.locking [None req-be9ddcb7-914f-4fb9-b261-35bafb531df8 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=63338) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  518.694976] env[63338]: DEBUG oslo_concurrency.lockutils [None req-be9ddcb7-914f-4fb9-b261-35bafb531df8 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=63338) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  518.695123] env[63338]: DEBUG oslo_concurrency.lockutils [None req-be9ddcb7-914f-4fb9-b261-35bafb531df8 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=63338) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  518.695548] env[63338]: DEBUG oslo_concurrency.lockutils [None req-be9ddcb7-914f-4fb9-b261-35bafb531df8 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=63338) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  518.705920] env[63338]: DEBUG oslo_concurrency.lockutils [None req-be9ddcb7-914f-4fb9-b261-35bafb531df8 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=63338) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  518.706461] env[63338]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-be9ddcb7-914f-4fb9-b261-35bafb531df8 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  518.706648] env[63338]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-be9ddcb7-914f-4fb9-b261-35bafb531df8 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=63338) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  520.712701] env[63338]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-be9ddcb7-914f-4fb9-b261-35bafb531df8 None None] Session token - acquiring
[  520.713063] env[63338]: DEBUG networking_nsxv3.common.locking [None req-be9ddcb7-914f-4fb9-b261-35bafb531df8 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=63338) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  520.713182] env[63338]: DEBUG oslo_concurrency.lockutils [None req-be9ddcb7-914f-4fb9-b261-35bafb531df8 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=63338) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  520.713296] env[63338]: DEBUG oslo_concurrency.lockutils [None req-be9ddcb7-914f-4fb9-b261-35bafb531df8 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=63338) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  520.713610] env[63338]: DEBUG oslo_concurrency.lockutils [None req-be9ddcb7-914f-4fb9-b261-35bafb531df8 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=63338) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  520.727776] env[63338]: DEBUG oslo_concurrency.lockutils [None req-be9ddcb7-914f-4fb9-b261-35bafb531df8 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=63338) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  520.728090] env[63338]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-be9ddcb7-914f-4fb9-b261-35bafb531df8 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  520.728236] env[63338]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-be9ddcb7-914f-4fb9-b261-35bafb531df8 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=63338) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  522.731288] env[63338]: CRITICAL neutron [None req-be9ddcb7-914f-4fb9-b261-35bafb531df8 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  522.731288] env[63338]: ERROR neutron Traceback (most recent call last):
[  522.731288] env[63338]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  522.731288] env[63338]: ERROR neutron     sys.exit(main())
[  522.731288] env[63338]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  522.731288] env[63338]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  522.731288] env[63338]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  522.731288] env[63338]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  522.731288] env[63338]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  522.731288] env[63338]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  522.731288] env[63338]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  522.731288] env[63338]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  522.731288] env[63338]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  522.731288] env[63338]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  522.731288] env[63338]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  522.731288] env[63338]: ERROR neutron     response = self.get(path=path, params=params)
[  522.731944] env[63338]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  522.731944] env[63338]: ERROR neutron     raise RuntimeError(msg, last_err)
[  522.731944] env[63338]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  522.731944] env[63338]: ERROR neutron 
[  525.780453] env[63843]: INFO neutron.common.config [-] Logging enabled!
[  525.780453] env[63843]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  525.780453] env[63843]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=63843) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  525.780453] env[63843]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  525.780453] env[63843]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  525.780453] env[63843]: WARNING oslo_policy.policy [None req-14662f04-b915-43e8-a041-93557d2b3d61 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  525.780453] env[63843]: WARNING oslo_policy.policy [None req-14662f04-b915-43e8-a041-93557d2b3d61 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  525.780877] env[63843]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-14662f04-b915-43e8-a041-93557d2b3d61 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  525.797004] env[63843]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-14662f04-b915-43e8-a041-93557d2b3d61 None None] Session token - acquiring
[  525.797868] env[63843]: DEBUG networking_nsxv3.common.locking [None req-14662f04-b915-43e8-a041-93557d2b3d61 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=63843) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  525.798079] env[63843]: DEBUG oslo_concurrency.lockutils [None req-14662f04-b915-43e8-a041-93557d2b3d61 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=63843) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  525.798204] env[63843]: DEBUG oslo_concurrency.lockutils [None req-14662f04-b915-43e8-a041-93557d2b3d61 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=63843) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  525.798573] env[63843]: DEBUG oslo_concurrency.lockutils [None req-14662f04-b915-43e8-a041-93557d2b3d61 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=63843) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  525.809684] env[63843]: DEBUG oslo_concurrency.lockutils [None req-14662f04-b915-43e8-a041-93557d2b3d61 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=63843) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  525.810068] env[63843]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-14662f04-b915-43e8-a041-93557d2b3d61 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  525.810260] env[63843]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-14662f04-b915-43e8-a041-93557d2b3d61 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=63843) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  527.816476] env[63843]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-14662f04-b915-43e8-a041-93557d2b3d61 None None] Session token - acquiring
[  527.816791] env[63843]: DEBUG networking_nsxv3.common.locking [None req-14662f04-b915-43e8-a041-93557d2b3d61 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=63843) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  527.816959] env[63843]: DEBUG oslo_concurrency.lockutils [None req-14662f04-b915-43e8-a041-93557d2b3d61 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=63843) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  527.817083] env[63843]: DEBUG oslo_concurrency.lockutils [None req-14662f04-b915-43e8-a041-93557d2b3d61 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=63843) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  527.817370] env[63843]: DEBUG oslo_concurrency.lockutils [None req-14662f04-b915-43e8-a041-93557d2b3d61 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=63843) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  527.826943] env[63843]: DEBUG oslo_concurrency.lockutils [None req-14662f04-b915-43e8-a041-93557d2b3d61 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=63843) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  527.827150] env[63843]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-14662f04-b915-43e8-a041-93557d2b3d61 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  527.827292] env[63843]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-14662f04-b915-43e8-a041-93557d2b3d61 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=63843) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  529.829201] env[63843]: CRITICAL neutron [None req-14662f04-b915-43e8-a041-93557d2b3d61 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  529.829201] env[63843]: ERROR neutron Traceback (most recent call last):
[  529.829201] env[63843]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  529.829201] env[63843]: ERROR neutron     sys.exit(main())
[  529.829201] env[63843]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  529.829201] env[63843]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  529.829201] env[63843]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  529.829201] env[63843]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  529.829201] env[63843]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  529.829201] env[63843]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  529.829201] env[63843]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  529.829201] env[63843]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  529.829201] env[63843]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  529.829201] env[63843]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  529.829201] env[63843]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  529.829201] env[63843]: ERROR neutron     response = self.get(path=path, params=params)
[  529.830020] env[63843]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  529.830020] env[63843]: ERROR neutron     raise RuntimeError(msg, last_err)
[  529.830020] env[63843]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  529.830020] env[63843]: ERROR neutron 
[  532.687973] env[64283]: INFO neutron.common.config [-] Logging enabled!
[  532.688287] env[64283]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  532.688604] env[64283]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=64283) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  532.688828] env[64283]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  532.688919] env[64283]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  532.689794] env[64283]: WARNING oslo_policy.policy [None req-3bbc60ce-3255-478d-8dbb-a02ee32b0f4f None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  532.690046] env[64283]: WARNING oslo_policy.policy [None req-3bbc60ce-3255-478d-8dbb-a02ee32b0f4f None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  532.691313] env[64283]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-3bbc60ce-3255-478d-8dbb-a02ee32b0f4f None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  532.706155] env[64283]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3bbc60ce-3255-478d-8dbb-a02ee32b0f4f None None] Session token - acquiring
[  532.707081] env[64283]: DEBUG networking_nsxv3.common.locking [None req-3bbc60ce-3255-478d-8dbb-a02ee32b0f4f None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=64283) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  532.707375] env[64283]: DEBUG oslo_concurrency.lockutils [None req-3bbc60ce-3255-478d-8dbb-a02ee32b0f4f None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=64283) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  532.707477] env[64283]: DEBUG oslo_concurrency.lockutils [None req-3bbc60ce-3255-478d-8dbb-a02ee32b0f4f None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=64283) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  532.707889] env[64283]: DEBUG oslo_concurrency.lockutils [None req-3bbc60ce-3255-478d-8dbb-a02ee32b0f4f None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=64283) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  532.717875] env[64283]: DEBUG oslo_concurrency.lockutils [None req-3bbc60ce-3255-478d-8dbb-a02ee32b0f4f None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=64283) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  532.718149] env[64283]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3bbc60ce-3255-478d-8dbb-a02ee32b0f4f None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  532.718309] env[64283]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3bbc60ce-3255-478d-8dbb-a02ee32b0f4f None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=64283) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  534.724894] env[64283]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3bbc60ce-3255-478d-8dbb-a02ee32b0f4f None None] Session token - acquiring
[  534.725197] env[64283]: DEBUG networking_nsxv3.common.locking [None req-3bbc60ce-3255-478d-8dbb-a02ee32b0f4f None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=64283) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  534.725423] env[64283]: DEBUG oslo_concurrency.lockutils [None req-3bbc60ce-3255-478d-8dbb-a02ee32b0f4f None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=64283) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  534.725568] env[64283]: DEBUG oslo_concurrency.lockutils [None req-3bbc60ce-3255-478d-8dbb-a02ee32b0f4f None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=64283) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  534.725883] env[64283]: DEBUG oslo_concurrency.lockutils [None req-3bbc60ce-3255-478d-8dbb-a02ee32b0f4f None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=64283) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  534.738756] env[64283]: DEBUG oslo_concurrency.lockutils [None req-3bbc60ce-3255-478d-8dbb-a02ee32b0f4f None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=64283) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  534.739008] env[64283]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3bbc60ce-3255-478d-8dbb-a02ee32b0f4f None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  534.739147] env[64283]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3bbc60ce-3255-478d-8dbb-a02ee32b0f4f None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=64283) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  536.741013] env[64283]: CRITICAL neutron [None req-3bbc60ce-3255-478d-8dbb-a02ee32b0f4f None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  536.741013] env[64283]: ERROR neutron Traceback (most recent call last):
[  536.741013] env[64283]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  536.741013] env[64283]: ERROR neutron     sys.exit(main())
[  536.741013] env[64283]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  536.741013] env[64283]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  536.741013] env[64283]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  536.741013] env[64283]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  536.741013] env[64283]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  536.741013] env[64283]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  536.741013] env[64283]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  536.741013] env[64283]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  536.741013] env[64283]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  536.741013] env[64283]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  536.741013] env[64283]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  536.741013] env[64283]: ERROR neutron     response = self.get(path=path, params=params)
[  536.741786] env[64283]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  536.741786] env[64283]: ERROR neutron     raise RuntimeError(msg, last_err)
[  536.741786] env[64283]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  536.741786] env[64283]: ERROR neutron 
[  539.839037] env[64708]: INFO neutron.common.config [-] Logging enabled!
[  539.839278] env[64708]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  539.839598] env[64708]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=64708) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  539.839906] env[64708]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  539.840017] env[64708]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  539.840898] env[64708]: WARNING oslo_policy.policy [None req-3b381eb5-f4a7-497b-a408-e58ad83e672a None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  539.841118] env[64708]: WARNING oslo_policy.policy [None req-3b381eb5-f4a7-497b-a408-e58ad83e672a None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  539.842411] env[64708]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-3b381eb5-f4a7-497b-a408-e58ad83e672a None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  539.856719] env[64708]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3b381eb5-f4a7-497b-a408-e58ad83e672a None None] Session token - acquiring
[  539.857570] env[64708]: DEBUG networking_nsxv3.common.locking [None req-3b381eb5-f4a7-497b-a408-e58ad83e672a None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=64708) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  539.857803] env[64708]: DEBUG oslo_concurrency.lockutils [None req-3b381eb5-f4a7-497b-a408-e58ad83e672a None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=64708) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  539.857933] env[64708]: DEBUG oslo_concurrency.lockutils [None req-3b381eb5-f4a7-497b-a408-e58ad83e672a None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=64708) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  539.858318] env[64708]: DEBUG oslo_concurrency.lockutils [None req-3b381eb5-f4a7-497b-a408-e58ad83e672a None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=64708) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  539.868123] env[64708]: DEBUG oslo_concurrency.lockutils [None req-3b381eb5-f4a7-497b-a408-e58ad83e672a None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=64708) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  539.868519] env[64708]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3b381eb5-f4a7-497b-a408-e58ad83e672a None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  539.869205] env[64708]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3b381eb5-f4a7-497b-a408-e58ad83e672a None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=64708) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  541.875284] env[64708]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3b381eb5-f4a7-497b-a408-e58ad83e672a None None] Session token - acquiring
[  541.875700] env[64708]: DEBUG networking_nsxv3.common.locking [None req-3b381eb5-f4a7-497b-a408-e58ad83e672a None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=64708) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  541.875827] env[64708]: DEBUG oslo_concurrency.lockutils [None req-3b381eb5-f4a7-497b-a408-e58ad83e672a None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=64708) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  541.875961] env[64708]: DEBUG oslo_concurrency.lockutils [None req-3b381eb5-f4a7-497b-a408-e58ad83e672a None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=64708) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  541.876349] env[64708]: DEBUG oslo_concurrency.lockutils [None req-3b381eb5-f4a7-497b-a408-e58ad83e672a None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=64708) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  541.885980] env[64708]: DEBUG oslo_concurrency.lockutils [None req-3b381eb5-f4a7-497b-a408-e58ad83e672a None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=64708) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  541.886298] env[64708]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3b381eb5-f4a7-497b-a408-e58ad83e672a None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  541.886379] env[64708]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3b381eb5-f4a7-497b-a408-e58ad83e672a None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=64708) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  543.889207] env[64708]: CRITICAL neutron [None req-3b381eb5-f4a7-497b-a408-e58ad83e672a None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  543.889207] env[64708]: ERROR neutron Traceback (most recent call last):
[  543.889207] env[64708]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  543.889207] env[64708]: ERROR neutron     sys.exit(main())
[  543.889207] env[64708]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  543.889207] env[64708]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  543.889207] env[64708]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  543.889207] env[64708]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  543.889207] env[64708]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  543.889207] env[64708]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  543.889207] env[64708]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  543.889207] env[64708]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  543.889207] env[64708]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  543.889207] env[64708]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  543.889207] env[64708]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  543.889207] env[64708]: ERROR neutron     response = self.get(path=path, params=params)
[  543.893202] env[64708]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  543.893202] env[64708]: ERROR neutron     raise RuntimeError(msg, last_err)
[  543.893202] env[64708]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  543.893202] env[64708]: ERROR neutron 
[  546.735378] env[65222]: INFO neutron.common.config [-] Logging enabled!
[  546.735639] env[65222]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  546.735913] env[65222]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=65222) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  546.736197] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  546.736291] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  546.737126] env[65222]: WARNING oslo_policy.policy [None req-657425fb-ffae-45db-b704-ac55297d9dcb None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  546.737351] env[65222]: WARNING oslo_policy.policy [None req-657425fb-ffae-45db-b704-ac55297d9dcb None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  546.738559] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-657425fb-ffae-45db-b704-ac55297d9dcb None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  546.752806] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-657425fb-ffae-45db-b704-ac55297d9dcb None None] Session token - acquiring
[  546.753602] env[65222]: DEBUG networking_nsxv3.common.locking [None req-657425fb-ffae-45db-b704-ac55297d9dcb None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  546.753809] env[65222]: DEBUG oslo_concurrency.lockutils [None req-657425fb-ffae-45db-b704-ac55297d9dcb None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  546.753937] env[65222]: DEBUG oslo_concurrency.lockutils [None req-657425fb-ffae-45db-b704-ac55297d9dcb None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  546.754304] env[65222]: DEBUG oslo_concurrency.lockutils [None req-657425fb-ffae-45db-b704-ac55297d9dcb None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  546.763341] env[65222]: DEBUG oslo_concurrency.lockutils [None req-657425fb-ffae-45db-b704-ac55297d9dcb None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  546.763601] env[65222]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-657425fb-ffae-45db-b704-ac55297d9dcb None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  546.763756] env[65222]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-657425fb-ffae-45db-b704-ac55297d9dcb None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=65222) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  548.771888] env[65222]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-657425fb-ffae-45db-b704-ac55297d9dcb None None] Session token - acquiring
[  548.771888] env[65222]: DEBUG networking_nsxv3.common.locking [None req-657425fb-ffae-45db-b704-ac55297d9dcb None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=65222) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  548.771888] env[65222]: DEBUG oslo_concurrency.lockutils [None req-657425fb-ffae-45db-b704-ac55297d9dcb None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  548.772520] env[65222]: DEBUG oslo_concurrency.lockutils [None req-657425fb-ffae-45db-b704-ac55297d9dcb None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  548.772520] env[65222]: DEBUG oslo_concurrency.lockutils [None req-657425fb-ffae-45db-b704-ac55297d9dcb None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  548.781240] env[65222]: DEBUG oslo_concurrency.lockutils [None req-657425fb-ffae-45db-b704-ac55297d9dcb None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65222) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  548.781622] env[65222]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-657425fb-ffae-45db-b704-ac55297d9dcb None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  548.781862] env[65222]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-657425fb-ffae-45db-b704-ac55297d9dcb None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=65222) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  550.785034] env[65222]: CRITICAL neutron [None req-657425fb-ffae-45db-b704-ac55297d9dcb None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  550.785034] env[65222]: ERROR neutron Traceback (most recent call last):
[  550.785034] env[65222]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  550.785034] env[65222]: ERROR neutron     sys.exit(main())
[  550.785034] env[65222]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  550.785034] env[65222]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  550.785034] env[65222]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  550.785034] env[65222]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  550.785034] env[65222]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  550.785034] env[65222]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  550.785034] env[65222]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  550.785034] env[65222]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  550.785034] env[65222]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  550.785034] env[65222]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  550.785034] env[65222]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  550.785034] env[65222]: ERROR neutron     response = self.get(path=path, params=params)
[  550.785794] env[65222]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  550.785794] env[65222]: ERROR neutron     raise RuntimeError(msg, last_err)
[  550.785794] env[65222]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  550.785794] env[65222]: ERROR neutron 
[  553.642557] env[65788]: INFO neutron.common.config [-] Logging enabled!
[  553.642829] env[65788]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  553.643379] env[65788]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=65788) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  553.643951] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  553.643951] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  553.644903] env[65788]: WARNING oslo_policy.policy [None req-ebf6e420-f7d8-4548-bb9d-f3292b040405 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  553.645359] env[65788]: WARNING oslo_policy.policy [None req-ebf6e420-f7d8-4548-bb9d-f3292b040405 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  553.646699] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-ebf6e420-f7d8-4548-bb9d-f3292b040405 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  553.664414] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ebf6e420-f7d8-4548-bb9d-f3292b040405 None None] Session token - acquiring
[  553.665627] env[65788]: DEBUG networking_nsxv3.common.locking [None req-ebf6e420-f7d8-4548-bb9d-f3292b040405 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  553.665907] env[65788]: DEBUG oslo_concurrency.lockutils [None req-ebf6e420-f7d8-4548-bb9d-f3292b040405 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  553.665944] env[65788]: DEBUG oslo_concurrency.lockutils [None req-ebf6e420-f7d8-4548-bb9d-f3292b040405 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  553.666570] env[65788]: DEBUG oslo_concurrency.lockutils [None req-ebf6e420-f7d8-4548-bb9d-f3292b040405 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  553.676788] env[65788]: DEBUG oslo_concurrency.lockutils [None req-ebf6e420-f7d8-4548-bb9d-f3292b040405 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  553.677057] env[65788]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ebf6e420-f7d8-4548-bb9d-f3292b040405 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  553.677203] env[65788]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ebf6e420-f7d8-4548-bb9d-f3292b040405 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=65788) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  555.684736] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ebf6e420-f7d8-4548-bb9d-f3292b040405 None None] Session token - acquiring
[  555.684736] env[65788]: DEBUG networking_nsxv3.common.locking [None req-ebf6e420-f7d8-4548-bb9d-f3292b040405 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  555.685184] env[65788]: DEBUG oslo_concurrency.lockutils [None req-ebf6e420-f7d8-4548-bb9d-f3292b040405 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  555.685184] env[65788]: DEBUG oslo_concurrency.lockutils [None req-ebf6e420-f7d8-4548-bb9d-f3292b040405 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  555.685266] env[65788]: DEBUG oslo_concurrency.lockutils [None req-ebf6e420-f7d8-4548-bb9d-f3292b040405 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  555.695561] env[65788]: DEBUG oslo_concurrency.lockutils [None req-ebf6e420-f7d8-4548-bb9d-f3292b040405 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  555.695998] env[65788]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ebf6e420-f7d8-4548-bb9d-f3292b040405 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  555.696341] env[65788]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ebf6e420-f7d8-4548-bb9d-f3292b040405 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=65788) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  557.699815] env[65788]: CRITICAL neutron [None req-ebf6e420-f7d8-4548-bb9d-f3292b040405 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  557.699815] env[65788]: ERROR neutron Traceback (most recent call last):
[  557.699815] env[65788]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  557.699815] env[65788]: ERROR neutron     sys.exit(main())
[  557.699815] env[65788]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  557.699815] env[65788]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  557.699815] env[65788]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  557.699815] env[65788]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  557.699815] env[65788]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  557.699815] env[65788]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  557.699815] env[65788]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  557.699815] env[65788]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  557.699815] env[65788]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  557.699815] env[65788]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  557.699815] env[65788]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  557.699815] env[65788]: ERROR neutron     response = self.get(path=path, params=params)
[  557.700830] env[65788]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  557.700830] env[65788]: ERROR neutron     raise RuntimeError(msg, last_err)
[  557.700830] env[65788]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  557.700830] env[65788]: ERROR neutron 
[  560.580706] env[66139]: INFO neutron.common.config [-] Logging enabled!
[  560.580963] env[66139]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  560.581165] env[66139]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=66139) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  560.581408] env[66139]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  560.581499] env[66139]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  560.582444] env[66139]: WARNING oslo_policy.policy [None req-f214f904-6aa6-4eab-9c20-45d807863df5 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  560.582668] env[66139]: WARNING oslo_policy.policy [None req-f214f904-6aa6-4eab-9c20-45d807863df5 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  560.583941] env[66139]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-f214f904-6aa6-4eab-9c20-45d807863df5 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  560.599041] env[66139]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f214f904-6aa6-4eab-9c20-45d807863df5 None None] Session token - acquiring
[  560.599964] env[66139]: DEBUG networking_nsxv3.common.locking [None req-f214f904-6aa6-4eab-9c20-45d807863df5 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=66139) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  560.600202] env[66139]: DEBUG oslo_concurrency.lockutils [None req-f214f904-6aa6-4eab-9c20-45d807863df5 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66139) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  560.600324] env[66139]: DEBUG oslo_concurrency.lockutils [None req-f214f904-6aa6-4eab-9c20-45d807863df5 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66139) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  560.600699] env[66139]: DEBUG oslo_concurrency.lockutils [None req-f214f904-6aa6-4eab-9c20-45d807863df5 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66139) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  560.610437] env[66139]: DEBUG oslo_concurrency.lockutils [None req-f214f904-6aa6-4eab-9c20-45d807863df5 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66139) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  560.610719] env[66139]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f214f904-6aa6-4eab-9c20-45d807863df5 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  560.611073] env[66139]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f214f904-6aa6-4eab-9c20-45d807863df5 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=66139) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  562.617107] env[66139]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f214f904-6aa6-4eab-9c20-45d807863df5 None None] Session token - acquiring
[  562.617446] env[66139]: DEBUG networking_nsxv3.common.locking [None req-f214f904-6aa6-4eab-9c20-45d807863df5 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=66139) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  562.617668] env[66139]: DEBUG oslo_concurrency.lockutils [None req-f214f904-6aa6-4eab-9c20-45d807863df5 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66139) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  562.617854] env[66139]: DEBUG oslo_concurrency.lockutils [None req-f214f904-6aa6-4eab-9c20-45d807863df5 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66139) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  562.618139] env[66139]: DEBUG oslo_concurrency.lockutils [None req-f214f904-6aa6-4eab-9c20-45d807863df5 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66139) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  562.627319] env[66139]: DEBUG oslo_concurrency.lockutils [None req-f214f904-6aa6-4eab-9c20-45d807863df5 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66139) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  562.627578] env[66139]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f214f904-6aa6-4eab-9c20-45d807863df5 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  562.627714] env[66139]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f214f904-6aa6-4eab-9c20-45d807863df5 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=66139) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  564.628977] env[66139]: CRITICAL neutron [None req-f214f904-6aa6-4eab-9c20-45d807863df5 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  564.628977] env[66139]: ERROR neutron Traceback (most recent call last):
[  564.628977] env[66139]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  564.628977] env[66139]: ERROR neutron     sys.exit(main())
[  564.628977] env[66139]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  564.628977] env[66139]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  564.628977] env[66139]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  564.628977] env[66139]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  564.628977] env[66139]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  564.628977] env[66139]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  564.628977] env[66139]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  564.628977] env[66139]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  564.628977] env[66139]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  564.628977] env[66139]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  564.628977] env[66139]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  564.628977] env[66139]: ERROR neutron     response = self.get(path=path, params=params)
[  564.629783] env[66139]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  564.629783] env[66139]: ERROR neutron     raise RuntimeError(msg, last_err)
[  564.629783] env[66139]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  564.629783] env[66139]: ERROR neutron 
[  567.416254] env[66577]: INFO neutron.common.config [-] Logging enabled!
[  567.416693] env[66577]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  567.416916] env[66577]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=66577) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  567.417131] env[66577]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  567.417236] env[66577]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  567.418206] env[66577]: WARNING oslo_policy.policy [None req-f34305a0-cf1b-4b69-a3b0-39b68a6ddeb8 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  567.418436] env[66577]: WARNING oslo_policy.policy [None req-f34305a0-cf1b-4b69-a3b0-39b68a6ddeb8 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  567.419714] env[66577]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-f34305a0-cf1b-4b69-a3b0-39b68a6ddeb8 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  567.439743] env[66577]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f34305a0-cf1b-4b69-a3b0-39b68a6ddeb8 None None] Session token - acquiring
[  567.441533] env[66577]: DEBUG networking_nsxv3.common.locking [None req-f34305a0-cf1b-4b69-a3b0-39b68a6ddeb8 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=66577) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  567.441533] env[66577]: DEBUG oslo_concurrency.lockutils [None req-f34305a0-cf1b-4b69-a3b0-39b68a6ddeb8 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66577) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  567.441705] env[66577]: DEBUG oslo_concurrency.lockutils [None req-f34305a0-cf1b-4b69-a3b0-39b68a6ddeb8 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66577) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  567.441705] env[66577]: DEBUG oslo_concurrency.lockutils [None req-f34305a0-cf1b-4b69-a3b0-39b68a6ddeb8 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66577) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  567.452166] env[66577]: DEBUG oslo_concurrency.lockutils [None req-f34305a0-cf1b-4b69-a3b0-39b68a6ddeb8 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66577) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  567.452465] env[66577]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f34305a0-cf1b-4b69-a3b0-39b68a6ddeb8 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  567.452616] env[66577]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f34305a0-cf1b-4b69-a3b0-39b68a6ddeb8 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=66577) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  569.461769] env[66577]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f34305a0-cf1b-4b69-a3b0-39b68a6ddeb8 None None] Session token - acquiring
[  569.461769] env[66577]: DEBUG networking_nsxv3.common.locking [None req-f34305a0-cf1b-4b69-a3b0-39b68a6ddeb8 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=66577) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  569.461769] env[66577]: DEBUG oslo_concurrency.lockutils [None req-f34305a0-cf1b-4b69-a3b0-39b68a6ddeb8 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66577) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  569.462348] env[66577]: DEBUG oslo_concurrency.lockutils [None req-f34305a0-cf1b-4b69-a3b0-39b68a6ddeb8 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66577) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  569.462348] env[66577]: DEBUG oslo_concurrency.lockutils [None req-f34305a0-cf1b-4b69-a3b0-39b68a6ddeb8 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66577) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  569.469751] env[66577]: DEBUG oslo_concurrency.lockutils [None req-f34305a0-cf1b-4b69-a3b0-39b68a6ddeb8 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66577) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  569.470064] env[66577]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f34305a0-cf1b-4b69-a3b0-39b68a6ddeb8 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  569.470170] env[66577]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f34305a0-cf1b-4b69-a3b0-39b68a6ddeb8 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=66577) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  571.473149] env[66577]: CRITICAL neutron [None req-f34305a0-cf1b-4b69-a3b0-39b68a6ddeb8 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  571.473149] env[66577]: ERROR neutron Traceback (most recent call last):
[  571.473149] env[66577]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  571.473149] env[66577]: ERROR neutron     sys.exit(main())
[  571.473149] env[66577]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  571.473149] env[66577]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  571.473149] env[66577]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  571.473149] env[66577]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  571.473149] env[66577]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  571.473149] env[66577]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  571.473149] env[66577]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  571.473149] env[66577]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  571.473149] env[66577]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  571.473149] env[66577]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  571.473149] env[66577]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  571.473149] env[66577]: ERROR neutron     response = self.get(path=path, params=params)
[  571.473937] env[66577]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  571.473937] env[66577]: ERROR neutron     raise RuntimeError(msg, last_err)
[  571.473937] env[66577]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  571.473937] env[66577]: ERROR neutron 
[  574.588952] env[67008]: INFO neutron.common.config [-] Logging enabled!
[  574.589245] env[67008]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  574.589540] env[67008]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=67008) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  574.589950] env[67008]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  574.590032] env[67008]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  574.590912] env[67008]: WARNING oslo_policy.policy [None req-6585b499-ea0d-477e-aaae-c899d7954157 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  574.591619] env[67008]: WARNING oslo_policy.policy [None req-6585b499-ea0d-477e-aaae-c899d7954157 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  574.594653] env[67008]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-6585b499-ea0d-477e-aaae-c899d7954157 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  574.608885] env[67008]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-6585b499-ea0d-477e-aaae-c899d7954157 None None] Session token - acquiring
[  574.609780] env[67008]: DEBUG networking_nsxv3.common.locking [None req-6585b499-ea0d-477e-aaae-c899d7954157 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=67008) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  574.610059] env[67008]: DEBUG oslo_concurrency.lockutils [None req-6585b499-ea0d-477e-aaae-c899d7954157 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67008) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  574.610193] env[67008]: DEBUG oslo_concurrency.lockutils [None req-6585b499-ea0d-477e-aaae-c899d7954157 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67008) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  574.610575] env[67008]: DEBUG oslo_concurrency.lockutils [None req-6585b499-ea0d-477e-aaae-c899d7954157 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67008) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  574.621190] env[67008]: DEBUG oslo_concurrency.lockutils [None req-6585b499-ea0d-477e-aaae-c899d7954157 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67008) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  574.621476] env[67008]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-6585b499-ea0d-477e-aaae-c899d7954157 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  574.621619] env[67008]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-6585b499-ea0d-477e-aaae-c899d7954157 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=67008) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  576.630164] env[67008]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-6585b499-ea0d-477e-aaae-c899d7954157 None None] Session token - acquiring
[  576.630540] env[67008]: DEBUG networking_nsxv3.common.locking [None req-6585b499-ea0d-477e-aaae-c899d7954157 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=67008) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  576.630753] env[67008]: DEBUG oslo_concurrency.lockutils [None req-6585b499-ea0d-477e-aaae-c899d7954157 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67008) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  576.630902] env[67008]: DEBUG oslo_concurrency.lockutils [None req-6585b499-ea0d-477e-aaae-c899d7954157 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67008) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  576.631200] env[67008]: DEBUG oslo_concurrency.lockutils [None req-6585b499-ea0d-477e-aaae-c899d7954157 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67008) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  576.640573] env[67008]: DEBUG oslo_concurrency.lockutils [None req-6585b499-ea0d-477e-aaae-c899d7954157 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67008) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  576.640906] env[67008]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-6585b499-ea0d-477e-aaae-c899d7954157 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  576.641184] env[67008]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-6585b499-ea0d-477e-aaae-c899d7954157 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=67008) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  578.644124] env[67008]: CRITICAL neutron [None req-6585b499-ea0d-477e-aaae-c899d7954157 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  578.644124] env[67008]: ERROR neutron Traceback (most recent call last):
[  578.644124] env[67008]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  578.644124] env[67008]: ERROR neutron     sys.exit(main())
[  578.644124] env[67008]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  578.644124] env[67008]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  578.644124] env[67008]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  578.644124] env[67008]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  578.644124] env[67008]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  578.644124] env[67008]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  578.644124] env[67008]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  578.644124] env[67008]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  578.644124] env[67008]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  578.644124] env[67008]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  578.644124] env[67008]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  578.644124] env[67008]: ERROR neutron     response = self.get(path=path, params=params)
[  578.644807] env[67008]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  578.644807] env[67008]: ERROR neutron     raise RuntimeError(msg, last_err)
[  578.644807] env[67008]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  578.644807] env[67008]: ERROR neutron 
[  581.485626] env[67415]: INFO neutron.common.config [-] Logging enabled!
[  581.485891] env[67415]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  581.486161] env[67415]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=67415) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  581.486388] env[67415]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  581.486478] env[67415]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  581.487341] env[67415]: WARNING oslo_policy.policy [None req-855647bc-3309-4143-8d22-b998895bf593 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  581.487556] env[67415]: WARNING oslo_policy.policy [None req-855647bc-3309-4143-8d22-b998895bf593 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  581.488865] env[67415]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-855647bc-3309-4143-8d22-b998895bf593 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  581.503879] env[67415]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-855647bc-3309-4143-8d22-b998895bf593 None None] Session token - acquiring
[  581.504784] env[67415]: DEBUG networking_nsxv3.common.locking [None req-855647bc-3309-4143-8d22-b998895bf593 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=67415) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  581.504986] env[67415]: DEBUG oslo_concurrency.lockutils [None req-855647bc-3309-4143-8d22-b998895bf593 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67415) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  581.505109] env[67415]: DEBUG oslo_concurrency.lockutils [None req-855647bc-3309-4143-8d22-b998895bf593 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67415) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  581.505483] env[67415]: DEBUG oslo_concurrency.lockutils [None req-855647bc-3309-4143-8d22-b998895bf593 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67415) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  581.514906] env[67415]: DEBUG oslo_concurrency.lockutils [None req-855647bc-3309-4143-8d22-b998895bf593 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67415) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  581.515419] env[67415]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-855647bc-3309-4143-8d22-b998895bf593 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  581.515575] env[67415]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-855647bc-3309-4143-8d22-b998895bf593 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=67415) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  583.523515] env[67415]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-855647bc-3309-4143-8d22-b998895bf593 None None] Session token - acquiring
[  583.524172] env[67415]: DEBUG networking_nsxv3.common.locking [None req-855647bc-3309-4143-8d22-b998895bf593 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=67415) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  583.524451] env[67415]: DEBUG oslo_concurrency.lockutils [None req-855647bc-3309-4143-8d22-b998895bf593 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67415) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  583.524578] env[67415]: DEBUG oslo_concurrency.lockutils [None req-855647bc-3309-4143-8d22-b998895bf593 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67415) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  583.524887] env[67415]: DEBUG oslo_concurrency.lockutils [None req-855647bc-3309-4143-8d22-b998895bf593 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67415) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  583.535377] env[67415]: DEBUG oslo_concurrency.lockutils [None req-855647bc-3309-4143-8d22-b998895bf593 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67415) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  583.536919] env[67415]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-855647bc-3309-4143-8d22-b998895bf593 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  583.537670] env[67415]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-855647bc-3309-4143-8d22-b998895bf593 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=67415) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  585.540908] env[67415]: CRITICAL neutron [None req-855647bc-3309-4143-8d22-b998895bf593 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  585.540908] env[67415]: ERROR neutron Traceback (most recent call last):
[  585.540908] env[67415]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  585.540908] env[67415]: ERROR neutron     sys.exit(main())
[  585.540908] env[67415]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  585.540908] env[67415]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  585.540908] env[67415]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  585.540908] env[67415]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  585.540908] env[67415]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  585.540908] env[67415]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  585.540908] env[67415]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  585.540908] env[67415]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  585.540908] env[67415]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  585.540908] env[67415]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  585.540908] env[67415]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  585.540908] env[67415]: ERROR neutron     response = self.get(path=path, params=params)
[  585.541640] env[67415]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  585.541640] env[67415]: ERROR neutron     raise RuntimeError(msg, last_err)
[  585.541640] env[67415]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  585.541640] env[67415]: ERROR neutron 
[  588.503345] env[67634]: INFO neutron.common.config [-] Logging enabled!
[  588.503609] env[67634]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  588.503888] env[67634]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=67634) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  588.504218] env[67634]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  588.504317] env[67634]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  588.505480] env[67634]: WARNING oslo_policy.policy [None req-f8f8d18c-a92d-470c-b8bc-a7c93f4e8892 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  588.505707] env[67634]: WARNING oslo_policy.policy [None req-f8f8d18c-a92d-470c-b8bc-a7c93f4e8892 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  588.507012] env[67634]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-f8f8d18c-a92d-470c-b8bc-a7c93f4e8892 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  588.521707] env[67634]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f8f8d18c-a92d-470c-b8bc-a7c93f4e8892 None None] Session token - acquiring
[  588.522708] env[67634]: DEBUG networking_nsxv3.common.locking [None req-f8f8d18c-a92d-470c-b8bc-a7c93f4e8892 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=67634) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  588.522806] env[67634]: DEBUG oslo_concurrency.lockutils [None req-f8f8d18c-a92d-470c-b8bc-a7c93f4e8892 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  588.522847] env[67634]: DEBUG oslo_concurrency.lockutils [None req-f8f8d18c-a92d-470c-b8bc-a7c93f4e8892 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  588.523499] env[67634]: DEBUG oslo_concurrency.lockutils [None req-f8f8d18c-a92d-470c-b8bc-a7c93f4e8892 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  588.538682] env[67634]: DEBUG oslo_concurrency.lockutils [None req-f8f8d18c-a92d-470c-b8bc-a7c93f4e8892 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  588.538961] env[67634]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f8f8d18c-a92d-470c-b8bc-a7c93f4e8892 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  588.539116] env[67634]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f8f8d18c-a92d-470c-b8bc-a7c93f4e8892 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=67634) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  590.545189] env[67634]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f8f8d18c-a92d-470c-b8bc-a7c93f4e8892 None None] Session token - acquiring
[  590.545536] env[67634]: DEBUG networking_nsxv3.common.locking [None req-f8f8d18c-a92d-470c-b8bc-a7c93f4e8892 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=67634) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  590.545667] env[67634]: DEBUG oslo_concurrency.lockutils [None req-f8f8d18c-a92d-470c-b8bc-a7c93f4e8892 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  590.545781] env[67634]: DEBUG oslo_concurrency.lockutils [None req-f8f8d18c-a92d-470c-b8bc-a7c93f4e8892 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  590.546066] env[67634]: DEBUG oslo_concurrency.lockutils [None req-f8f8d18c-a92d-470c-b8bc-a7c93f4e8892 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  590.555923] env[67634]: DEBUG oslo_concurrency.lockutils [None req-f8f8d18c-a92d-470c-b8bc-a7c93f4e8892 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  590.556324] env[67634]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f8f8d18c-a92d-470c-b8bc-a7c93f4e8892 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  590.556470] env[67634]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f8f8d18c-a92d-470c-b8bc-a7c93f4e8892 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=67634) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  592.559406] env[67634]: CRITICAL neutron [None req-f8f8d18c-a92d-470c-b8bc-a7c93f4e8892 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  592.559406] env[67634]: ERROR neutron Traceback (most recent call last):
[  592.559406] env[67634]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  592.559406] env[67634]: ERROR neutron     sys.exit(main())
[  592.559406] env[67634]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  592.559406] env[67634]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  592.559406] env[67634]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  592.559406] env[67634]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  592.559406] env[67634]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  592.559406] env[67634]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  592.559406] env[67634]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  592.559406] env[67634]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  592.559406] env[67634]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  592.559406] env[67634]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  592.559406] env[67634]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  592.559406] env[67634]: ERROR neutron     response = self.get(path=path, params=params)
[  592.560207] env[67634]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  592.560207] env[67634]: ERROR neutron     raise RuntimeError(msg, last_err)
[  592.560207] env[67634]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  592.560207] env[67634]: ERROR neutron 
[  595.336369] env[68039]: INFO neutron.common.config [-] Logging enabled!
[  595.336608] env[68039]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  595.337287] env[68039]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=68039) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  595.337773] env[68039]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  595.337957] env[68039]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  595.339081] env[68039]: WARNING oslo_policy.policy [None req-f6e9c02a-86fb-4990-a52b-36ae2fcf114a None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  595.339081] env[68039]: WARNING oslo_policy.policy [None req-f6e9c02a-86fb-4990-a52b-36ae2fcf114a None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  595.340426] env[68039]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-f6e9c02a-86fb-4990-a52b-36ae2fcf114a None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  595.355433] env[68039]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f6e9c02a-86fb-4990-a52b-36ae2fcf114a None None] Session token - acquiring
[  595.356364] env[68039]: DEBUG networking_nsxv3.common.locking [None req-f6e9c02a-86fb-4990-a52b-36ae2fcf114a None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=68039) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  595.356616] env[68039]: DEBUG oslo_concurrency.lockutils [None req-f6e9c02a-86fb-4990-a52b-36ae2fcf114a None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  595.356761] env[68039]: DEBUG oslo_concurrency.lockutils [None req-f6e9c02a-86fb-4990-a52b-36ae2fcf114a None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  595.357214] env[68039]: DEBUG oslo_concurrency.lockutils [None req-f6e9c02a-86fb-4990-a52b-36ae2fcf114a None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  595.367323] env[68039]: DEBUG oslo_concurrency.lockutils [None req-f6e9c02a-86fb-4990-a52b-36ae2fcf114a None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  595.367585] env[68039]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f6e9c02a-86fb-4990-a52b-36ae2fcf114a None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  595.367743] env[68039]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f6e9c02a-86fb-4990-a52b-36ae2fcf114a None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=68039) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  597.373813] env[68039]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f6e9c02a-86fb-4990-a52b-36ae2fcf114a None None] Session token - acquiring
[  597.374199] env[68039]: DEBUG networking_nsxv3.common.locking [None req-f6e9c02a-86fb-4990-a52b-36ae2fcf114a None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=68039) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  597.374417] env[68039]: DEBUG oslo_concurrency.lockutils [None req-f6e9c02a-86fb-4990-a52b-36ae2fcf114a None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  597.374610] env[68039]: DEBUG oslo_concurrency.lockutils [None req-f6e9c02a-86fb-4990-a52b-36ae2fcf114a None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  597.374823] env[68039]: DEBUG oslo_concurrency.lockutils [None req-f6e9c02a-86fb-4990-a52b-36ae2fcf114a None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  597.384015] env[68039]: DEBUG oslo_concurrency.lockutils [None req-f6e9c02a-86fb-4990-a52b-36ae2fcf114a None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  597.384268] env[68039]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f6e9c02a-86fb-4990-a52b-36ae2fcf114a None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  597.384387] env[68039]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f6e9c02a-86fb-4990-a52b-36ae2fcf114a None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=68039) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  599.387437] env[68039]: CRITICAL neutron [None req-f6e9c02a-86fb-4990-a52b-36ae2fcf114a None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  599.387437] env[68039]: ERROR neutron Traceback (most recent call last):
[  599.387437] env[68039]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  599.387437] env[68039]: ERROR neutron     sys.exit(main())
[  599.387437] env[68039]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  599.387437] env[68039]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  599.387437] env[68039]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  599.387437] env[68039]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  599.387437] env[68039]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  599.387437] env[68039]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  599.387437] env[68039]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  599.387437] env[68039]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  599.387437] env[68039]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  599.387437] env[68039]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  599.387437] env[68039]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  599.387437] env[68039]: ERROR neutron     response = self.get(path=path, params=params)
[  599.388186] env[68039]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  599.388186] env[68039]: ERROR neutron     raise RuntimeError(msg, last_err)
[  599.388186] env[68039]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  599.388186] env[68039]: ERROR neutron 
[  602.189268] env[68312]: INFO neutron.common.config [-] Logging enabled!
[  602.189564] env[68312]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  602.189842] env[68312]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=68312) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  602.190121] env[68312]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  602.190216] env[68312]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  602.191133] env[68312]: WARNING oslo_policy.policy [None req-de31ad61-e562-4c84-a381-6a4d789c0d05 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  602.191357] env[68312]: WARNING oslo_policy.policy [None req-de31ad61-e562-4c84-a381-6a4d789c0d05 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  602.192731] env[68312]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-de31ad61-e562-4c84-a381-6a4d789c0d05 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  602.210904] env[68312]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-de31ad61-e562-4c84-a381-6a4d789c0d05 None None] Session token - acquiring
[  602.210904] env[68312]: DEBUG networking_nsxv3.common.locking [None req-de31ad61-e562-4c84-a381-6a4d789c0d05 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=68312) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  602.211080] env[68312]: DEBUG oslo_concurrency.lockutils [None req-de31ad61-e562-4c84-a381-6a4d789c0d05 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68312) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  602.211204] env[68312]: DEBUG oslo_concurrency.lockutils [None req-de31ad61-e562-4c84-a381-6a4d789c0d05 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68312) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  602.212552] env[68312]: DEBUG oslo_concurrency.lockutils [None req-de31ad61-e562-4c84-a381-6a4d789c0d05 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68312) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  602.221579] env[68312]: DEBUG oslo_concurrency.lockutils [None req-de31ad61-e562-4c84-a381-6a4d789c0d05 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68312) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  602.221579] env[68312]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-de31ad61-e562-4c84-a381-6a4d789c0d05 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  602.221579] env[68312]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-de31ad61-e562-4c84-a381-6a4d789c0d05 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=68312) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  604.228529] env[68312]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-de31ad61-e562-4c84-a381-6a4d789c0d05 None None] Session token - acquiring
[  604.228822] env[68312]: DEBUG networking_nsxv3.common.locking [None req-de31ad61-e562-4c84-a381-6a4d789c0d05 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=68312) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  604.229025] env[68312]: DEBUG oslo_concurrency.lockutils [None req-de31ad61-e562-4c84-a381-6a4d789c0d05 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68312) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  604.229151] env[68312]: DEBUG oslo_concurrency.lockutils [None req-de31ad61-e562-4c84-a381-6a4d789c0d05 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68312) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  604.229435] env[68312]: DEBUG oslo_concurrency.lockutils [None req-de31ad61-e562-4c84-a381-6a4d789c0d05 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68312) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  604.239094] env[68312]: DEBUG oslo_concurrency.lockutils [None req-de31ad61-e562-4c84-a381-6a4d789c0d05 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68312) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  604.239690] env[68312]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-de31ad61-e562-4c84-a381-6a4d789c0d05 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  604.239690] env[68312]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-de31ad61-e562-4c84-a381-6a4d789c0d05 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=68312) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  606.242257] env[68312]: CRITICAL neutron [None req-de31ad61-e562-4c84-a381-6a4d789c0d05 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  606.242257] env[68312]: ERROR neutron Traceback (most recent call last):
[  606.242257] env[68312]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  606.242257] env[68312]: ERROR neutron     sys.exit(main())
[  606.242257] env[68312]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  606.242257] env[68312]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  606.242257] env[68312]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  606.242257] env[68312]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  606.242257] env[68312]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  606.242257] env[68312]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  606.242257] env[68312]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  606.242257] env[68312]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  606.242257] env[68312]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  606.242257] env[68312]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  606.242257] env[68312]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  606.242257] env[68312]: ERROR neutron     response = self.get(path=path, params=params)
[  606.243256] env[68312]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  606.243256] env[68312]: ERROR neutron     raise RuntimeError(msg, last_err)
[  606.243256] env[68312]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  606.243256] env[68312]: ERROR neutron 
[  609.029779] env[68586]: INFO neutron.common.config [-] Logging enabled!
[  609.030079] env[68586]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  609.030358] env[68586]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=68586) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  609.030587] env[68586]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  609.030677] env[68586]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  609.031655] env[68586]: WARNING oslo_policy.policy [None req-21f3d2de-50b6-4052-943f-f566e99d464b None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  609.032699] env[68586]: WARNING oslo_policy.policy [None req-21f3d2de-50b6-4052-943f-f566e99d464b None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  609.036756] env[68586]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-21f3d2de-50b6-4052-943f-f566e99d464b None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  609.047790] env[68586]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-21f3d2de-50b6-4052-943f-f566e99d464b None None] Session token - acquiring
[  609.048693] env[68586]: DEBUG networking_nsxv3.common.locking [None req-21f3d2de-50b6-4052-943f-f566e99d464b None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=68586) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  609.048901] env[68586]: DEBUG oslo_concurrency.lockutils [None req-21f3d2de-50b6-4052-943f-f566e99d464b None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68586) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  609.049043] env[68586]: DEBUG oslo_concurrency.lockutils [None req-21f3d2de-50b6-4052-943f-f566e99d464b None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68586) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  609.049467] env[68586]: DEBUG oslo_concurrency.lockutils [None req-21f3d2de-50b6-4052-943f-f566e99d464b None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68586) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  609.059221] env[68586]: DEBUG oslo_concurrency.lockutils [None req-21f3d2de-50b6-4052-943f-f566e99d464b None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68586) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  609.059485] env[68586]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-21f3d2de-50b6-4052-943f-f566e99d464b None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  609.059631] env[68586]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-21f3d2de-50b6-4052-943f-f566e99d464b None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=68586) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  611.065693] env[68586]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-21f3d2de-50b6-4052-943f-f566e99d464b None None] Session token - acquiring
[  611.065990] env[68586]: DEBUG networking_nsxv3.common.locking [None req-21f3d2de-50b6-4052-943f-f566e99d464b None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=68586) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  611.066186] env[68586]: DEBUG oslo_concurrency.lockutils [None req-21f3d2de-50b6-4052-943f-f566e99d464b None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68586) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  611.066310] env[68586]: DEBUG oslo_concurrency.lockutils [None req-21f3d2de-50b6-4052-943f-f566e99d464b None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68586) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  611.066589] env[68586]: DEBUG oslo_concurrency.lockutils [None req-21f3d2de-50b6-4052-943f-f566e99d464b None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68586) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  611.075653] env[68586]: DEBUG oslo_concurrency.lockutils [None req-21f3d2de-50b6-4052-943f-f566e99d464b None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68586) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  611.075912] env[68586]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-21f3d2de-50b6-4052-943f-f566e99d464b None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  611.076072] env[68586]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-21f3d2de-50b6-4052-943f-f566e99d464b None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=68586) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  613.079009] env[68586]: CRITICAL neutron [None req-21f3d2de-50b6-4052-943f-f566e99d464b None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  613.079009] env[68586]: ERROR neutron Traceback (most recent call last):
[  613.079009] env[68586]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  613.079009] env[68586]: ERROR neutron     sys.exit(main())
[  613.079009] env[68586]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  613.079009] env[68586]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  613.079009] env[68586]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  613.079009] env[68586]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  613.079009] env[68586]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  613.079009] env[68586]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  613.079009] env[68586]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  613.079009] env[68586]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  613.079009] env[68586]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  613.079009] env[68586]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  613.079009] env[68586]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  613.079009] env[68586]: ERROR neutron     response = self.get(path=path, params=params)
[  613.080469] env[68586]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  613.080469] env[68586]: ERROR neutron     raise RuntimeError(msg, last_err)
[  613.080469] env[68586]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  613.080469] env[68586]: ERROR neutron 
[  615.899641] env[68913]: INFO neutron.common.config [-] Logging enabled!
[  615.899924] env[68913]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  615.900229] env[68913]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=68913) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  615.900458] env[68913]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  615.900546] env[68913]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  615.901413] env[68913]: WARNING oslo_policy.policy [None req-bb70d60f-71bf-4c3b-b574-165d02116853 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  615.901618] env[68913]: WARNING oslo_policy.policy [None req-bb70d60f-71bf-4c3b-b574-165d02116853 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  615.902934] env[68913]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-bb70d60f-71bf-4c3b-b574-165d02116853 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  615.917121] env[68913]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-bb70d60f-71bf-4c3b-b574-165d02116853 None None] Session token - acquiring
[  615.917974] env[68913]: DEBUG networking_nsxv3.common.locking [None req-bb70d60f-71bf-4c3b-b574-165d02116853 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=68913) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  615.918181] env[68913]: DEBUG oslo_concurrency.lockutils [None req-bb70d60f-71bf-4c3b-b574-165d02116853 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68913) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  615.918303] env[68913]: DEBUG oslo_concurrency.lockutils [None req-bb70d60f-71bf-4c3b-b574-165d02116853 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68913) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  615.918690] env[68913]: DEBUG oslo_concurrency.lockutils [None req-bb70d60f-71bf-4c3b-b574-165d02116853 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68913) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  615.928083] env[68913]: DEBUG oslo_concurrency.lockutils [None req-bb70d60f-71bf-4c3b-b574-165d02116853 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68913) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  615.928362] env[68913]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-bb70d60f-71bf-4c3b-b574-165d02116853 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  615.928486] env[68913]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-bb70d60f-71bf-4c3b-b574-165d02116853 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=68913) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  617.934456] env[68913]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-bb70d60f-71bf-4c3b-b574-165d02116853 None None] Session token - acquiring
[  617.934767] env[68913]: DEBUG networking_nsxv3.common.locking [None req-bb70d60f-71bf-4c3b-b574-165d02116853 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=68913) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  617.934931] env[68913]: DEBUG oslo_concurrency.lockutils [None req-bb70d60f-71bf-4c3b-b574-165d02116853 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68913) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  617.935049] env[68913]: DEBUG oslo_concurrency.lockutils [None req-bb70d60f-71bf-4c3b-b574-165d02116853 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68913) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  617.935320] env[68913]: DEBUG oslo_concurrency.lockutils [None req-bb70d60f-71bf-4c3b-b574-165d02116853 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68913) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  617.944514] env[68913]: DEBUG oslo_concurrency.lockutils [None req-bb70d60f-71bf-4c3b-b574-165d02116853 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68913) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  617.944745] env[68913]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-bb70d60f-71bf-4c3b-b574-165d02116853 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  617.944877] env[68913]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-bb70d60f-71bf-4c3b-b574-165d02116853 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=68913) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  619.947810] env[68913]: CRITICAL neutron [None req-bb70d60f-71bf-4c3b-b574-165d02116853 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  619.947810] env[68913]: ERROR neutron Traceback (most recent call last):
[  619.947810] env[68913]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  619.947810] env[68913]: ERROR neutron     sys.exit(main())
[  619.947810] env[68913]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  619.947810] env[68913]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  619.947810] env[68913]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  619.947810] env[68913]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  619.947810] env[68913]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  619.947810] env[68913]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  619.947810] env[68913]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  619.947810] env[68913]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  619.947810] env[68913]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  619.947810] env[68913]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  619.947810] env[68913]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  619.947810] env[68913]: ERROR neutron     response = self.get(path=path, params=params)
[  619.948466] env[68913]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  619.948466] env[68913]: ERROR neutron     raise RuntimeError(msg, last_err)
[  619.948466] env[68913]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  619.948466] env[68913]: ERROR neutron 
[  622.611483] env[69094]: INFO neutron.common.config [-] Logging enabled!
[  622.611845] env[69094]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  622.612025] env[69094]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=69094) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  622.612268] env[69094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  622.612362] env[69094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  622.613268] env[69094]: WARNING oslo_policy.policy [None req-0f82c8bf-d45c-4885-9a98-a195c0469d28 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  622.613441] env[69094]: WARNING oslo_policy.policy [None req-0f82c8bf-d45c-4885-9a98-a195c0469d28 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  622.614687] env[69094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-0f82c8bf-d45c-4885-9a98-a195c0469d28 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  622.630403] env[69094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-0f82c8bf-d45c-4885-9a98-a195c0469d28 None None] Session token - acquiring
[  622.631427] env[69094]: DEBUG networking_nsxv3.common.locking [None req-0f82c8bf-d45c-4885-9a98-a195c0469d28 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=69094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  622.631624] env[69094]: DEBUG oslo_concurrency.lockutils [None req-0f82c8bf-d45c-4885-9a98-a195c0469d28 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  622.631748] env[69094]: DEBUG oslo_concurrency.lockutils [None req-0f82c8bf-d45c-4885-9a98-a195c0469d28 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  622.632125] env[69094]: DEBUG oslo_concurrency.lockutils [None req-0f82c8bf-d45c-4885-9a98-a195c0469d28 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  622.640994] env[69094]: DEBUG oslo_concurrency.lockutils [None req-0f82c8bf-d45c-4885-9a98-a195c0469d28 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  622.641256] env[69094]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-0f82c8bf-d45c-4885-9a98-a195c0469d28 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  622.641411] env[69094]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-0f82c8bf-d45c-4885-9a98-a195c0469d28 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=69094) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  624.648491] env[69094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-0f82c8bf-d45c-4885-9a98-a195c0469d28 None None] Session token - acquiring
[  624.648882] env[69094]: DEBUG networking_nsxv3.common.locking [None req-0f82c8bf-d45c-4885-9a98-a195c0469d28 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=69094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  624.649100] env[69094]: DEBUG oslo_concurrency.lockutils [None req-0f82c8bf-d45c-4885-9a98-a195c0469d28 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  624.649232] env[69094]: DEBUG oslo_concurrency.lockutils [None req-0f82c8bf-d45c-4885-9a98-a195c0469d28 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  624.649501] env[69094]: DEBUG oslo_concurrency.lockutils [None req-0f82c8bf-d45c-4885-9a98-a195c0469d28 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  624.662397] env[69094]: DEBUG oslo_concurrency.lockutils [None req-0f82c8bf-d45c-4885-9a98-a195c0469d28 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  624.662832] env[69094]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-0f82c8bf-d45c-4885-9a98-a195c0469d28 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  624.662986] env[69094]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-0f82c8bf-d45c-4885-9a98-a195c0469d28 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=69094) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  626.664899] env[69094]: CRITICAL neutron [None req-0f82c8bf-d45c-4885-9a98-a195c0469d28 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  626.664899] env[69094]: ERROR neutron Traceback (most recent call last):
[  626.664899] env[69094]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  626.664899] env[69094]: ERROR neutron     sys.exit(main())
[  626.664899] env[69094]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  626.664899] env[69094]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  626.664899] env[69094]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  626.664899] env[69094]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  626.664899] env[69094]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  626.664899] env[69094]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  626.664899] env[69094]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  626.664899] env[69094]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  626.664899] env[69094]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  626.664899] env[69094]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  626.664899] env[69094]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  626.664899] env[69094]: ERROR neutron     response = self.get(path=path, params=params)
[  626.665646] env[69094]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  626.665646] env[69094]: ERROR neutron     raise RuntimeError(msg, last_err)
[  626.665646] env[69094]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  626.665646] env[69094]: ERROR neutron 
[  629.385241] env[69130]: INFO neutron.common.config [-] Logging enabled!
[  629.385512] env[69130]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  629.385755] env[69130]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=69130) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  629.385978] env[69130]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  629.386067] env[69130]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  629.387096] env[69130]: WARNING oslo_policy.policy [None req-c98ec606-7100-42a9-83f4-907f2fed5efb None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  629.387315] env[69130]: WARNING oslo_policy.policy [None req-c98ec606-7100-42a9-83f4-907f2fed5efb None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  629.388547] env[69130]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-c98ec606-7100-42a9-83f4-907f2fed5efb None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  629.402740] env[69130]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-c98ec606-7100-42a9-83f4-907f2fed5efb None None] Session token - acquiring
[  629.403531] env[69130]: DEBUG networking_nsxv3.common.locking [None req-c98ec606-7100-42a9-83f4-907f2fed5efb None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=69130) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  629.403724] env[69130]: DEBUG oslo_concurrency.lockutils [None req-c98ec606-7100-42a9-83f4-907f2fed5efb None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69130) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  629.403850] env[69130]: DEBUG oslo_concurrency.lockutils [None req-c98ec606-7100-42a9-83f4-907f2fed5efb None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69130) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  629.404234] env[69130]: DEBUG oslo_concurrency.lockutils [None req-c98ec606-7100-42a9-83f4-907f2fed5efb None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69130) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  629.416914] env[69130]: DEBUG oslo_concurrency.lockutils [None req-c98ec606-7100-42a9-83f4-907f2fed5efb None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69130) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  629.417207] env[69130]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-c98ec606-7100-42a9-83f4-907f2fed5efb None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  629.417362] env[69130]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-c98ec606-7100-42a9-83f4-907f2fed5efb None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=69130) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  631.423687] env[69130]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-c98ec606-7100-42a9-83f4-907f2fed5efb None None] Session token - acquiring
[  631.423988] env[69130]: DEBUG networking_nsxv3.common.locking [None req-c98ec606-7100-42a9-83f4-907f2fed5efb None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=69130) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  631.424132] env[69130]: DEBUG oslo_concurrency.lockutils [None req-c98ec606-7100-42a9-83f4-907f2fed5efb None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69130) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  631.424230] env[69130]: DEBUG oslo_concurrency.lockutils [None req-c98ec606-7100-42a9-83f4-907f2fed5efb None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69130) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  631.424513] env[69130]: DEBUG oslo_concurrency.lockutils [None req-c98ec606-7100-42a9-83f4-907f2fed5efb None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69130) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  631.433611] env[69130]: DEBUG oslo_concurrency.lockutils [None req-c98ec606-7100-42a9-83f4-907f2fed5efb None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69130) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  631.433846] env[69130]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-c98ec606-7100-42a9-83f4-907f2fed5efb None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  631.433980] env[69130]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-c98ec606-7100-42a9-83f4-907f2fed5efb None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=69130) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  633.436999] env[69130]: CRITICAL neutron [None req-c98ec606-7100-42a9-83f4-907f2fed5efb None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  633.436999] env[69130]: ERROR neutron Traceback (most recent call last):
[  633.436999] env[69130]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  633.436999] env[69130]: ERROR neutron     sys.exit(main())
[  633.436999] env[69130]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  633.436999] env[69130]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  633.436999] env[69130]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  633.436999] env[69130]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  633.436999] env[69130]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  633.436999] env[69130]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  633.436999] env[69130]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  633.436999] env[69130]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  633.436999] env[69130]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  633.436999] env[69130]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  633.436999] env[69130]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  633.436999] env[69130]: ERROR neutron     response = self.get(path=path, params=params)
[  633.437599] env[69130]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  633.437599] env[69130]: ERROR neutron     raise RuntimeError(msg, last_err)
[  633.437599] env[69130]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  633.437599] env[69130]: ERROR neutron 
[  636.062064] env[69256]: INFO neutron.common.config [-] Logging enabled!
[  636.062434] env[69256]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  636.062602] env[69256]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=69256) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  636.062825] env[69256]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  636.062928] env[69256]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  636.063836] env[69256]: WARNING oslo_policy.policy [None req-ba7b551f-5ee8-400f-93d6-7189196717e2 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  636.064266] env[69256]: WARNING oslo_policy.policy [None req-ba7b551f-5ee8-400f-93d6-7189196717e2 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  636.065529] env[69256]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-ba7b551f-5ee8-400f-93d6-7189196717e2 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  636.079723] env[69256]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ba7b551f-5ee8-400f-93d6-7189196717e2 None None] Session token - acquiring
[  636.088481] env[69256]: DEBUG networking_nsxv3.common.locking [None req-ba7b551f-5ee8-400f-93d6-7189196717e2 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=69256) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  636.088481] env[69256]: DEBUG oslo_concurrency.lockutils [None req-ba7b551f-5ee8-400f-93d6-7189196717e2 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69256) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  636.088899] env[69256]: DEBUG oslo_concurrency.lockutils [None req-ba7b551f-5ee8-400f-93d6-7189196717e2 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69256) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  636.088899] env[69256]: DEBUG oslo_concurrency.lockutils [None req-ba7b551f-5ee8-400f-93d6-7189196717e2 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69256) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  636.091522] env[69256]: DEBUG oslo_concurrency.lockutils [None req-ba7b551f-5ee8-400f-93d6-7189196717e2 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69256) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  636.092238] env[69256]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ba7b551f-5ee8-400f-93d6-7189196717e2 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  636.092405] env[69256]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ba7b551f-5ee8-400f-93d6-7189196717e2 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=69256) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  638.100410] env[69256]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ba7b551f-5ee8-400f-93d6-7189196717e2 None None] Session token - acquiring
[  638.100705] env[69256]: DEBUG networking_nsxv3.common.locking [None req-ba7b551f-5ee8-400f-93d6-7189196717e2 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=69256) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  638.100935] env[69256]: DEBUG oslo_concurrency.lockutils [None req-ba7b551f-5ee8-400f-93d6-7189196717e2 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69256) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  638.101066] env[69256]: DEBUG oslo_concurrency.lockutils [None req-ba7b551f-5ee8-400f-93d6-7189196717e2 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69256) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  638.101348] env[69256]: DEBUG oslo_concurrency.lockutils [None req-ba7b551f-5ee8-400f-93d6-7189196717e2 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69256) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  638.111962] env[69256]: DEBUG oslo_concurrency.lockutils [None req-ba7b551f-5ee8-400f-93d6-7189196717e2 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69256) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  638.111962] env[69256]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ba7b551f-5ee8-400f-93d6-7189196717e2 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  638.111962] env[69256]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ba7b551f-5ee8-400f-93d6-7189196717e2 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=69256) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  640.113015] env[69256]: CRITICAL neutron [None req-ba7b551f-5ee8-400f-93d6-7189196717e2 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  640.113015] env[69256]: ERROR neutron Traceback (most recent call last):
[  640.113015] env[69256]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  640.113015] env[69256]: ERROR neutron     sys.exit(main())
[  640.113015] env[69256]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  640.113015] env[69256]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  640.113015] env[69256]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  640.113015] env[69256]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  640.113015] env[69256]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  640.113015] env[69256]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  640.113015] env[69256]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  640.113015] env[69256]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  640.113015] env[69256]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  640.113015] env[69256]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  640.113015] env[69256]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  640.113015] env[69256]: ERROR neutron     response = self.get(path=path, params=params)
[  640.113747] env[69256]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  640.113747] env[69256]: ERROR neutron     raise RuntimeError(msg, last_err)
[  640.113747] env[69256]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  640.113747] env[69256]: ERROR neutron 
[  642.789716] env[69446]: INFO neutron.common.config [-] Logging enabled!
[  642.790019] env[69446]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  642.790222] env[69446]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=69446) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  642.790445] env[69446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  642.790538] env[69446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  642.791367] env[69446]: WARNING oslo_policy.policy [None req-5b4e23d5-d773-418f-ad14-7c7f528d3f8e None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  642.791591] env[69446]: WARNING oslo_policy.policy [None req-5b4e23d5-d773-418f-ad14-7c7f528d3f8e None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  642.792794] env[69446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-5b4e23d5-d773-418f-ad14-7c7f528d3f8e None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  642.806890] env[69446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5b4e23d5-d773-418f-ad14-7c7f528d3f8e None None] Session token - acquiring
[  642.807701] env[69446]: DEBUG networking_nsxv3.common.locking [None req-5b4e23d5-d773-418f-ad14-7c7f528d3f8e None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=69446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  642.808040] env[69446]: DEBUG oslo_concurrency.lockutils [None req-5b4e23d5-d773-418f-ad14-7c7f528d3f8e None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  642.808188] env[69446]: DEBUG oslo_concurrency.lockutils [None req-5b4e23d5-d773-418f-ad14-7c7f528d3f8e None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  642.808580] env[69446]: DEBUG oslo_concurrency.lockutils [None req-5b4e23d5-d773-418f-ad14-7c7f528d3f8e None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  642.820445] env[69446]: DEBUG oslo_concurrency.lockutils [None req-5b4e23d5-d773-418f-ad14-7c7f528d3f8e None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  642.820705] env[69446]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5b4e23d5-d773-418f-ad14-7c7f528d3f8e None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  642.820908] env[69446]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5b4e23d5-d773-418f-ad14-7c7f528d3f8e None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=69446) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  644.826998] env[69446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5b4e23d5-d773-418f-ad14-7c7f528d3f8e None None] Session token - acquiring
[  644.827316] env[69446]: DEBUG networking_nsxv3.common.locking [None req-5b4e23d5-d773-418f-ad14-7c7f528d3f8e None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=69446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  644.828102] env[69446]: DEBUG oslo_concurrency.lockutils [None req-5b4e23d5-d773-418f-ad14-7c7f528d3f8e None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  644.828102] env[69446]: DEBUG oslo_concurrency.lockutils [None req-5b4e23d5-d773-418f-ad14-7c7f528d3f8e None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  644.828102] env[69446]: DEBUG oslo_concurrency.lockutils [None req-5b4e23d5-d773-418f-ad14-7c7f528d3f8e None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  644.839147] env[69446]: DEBUG oslo_concurrency.lockutils [None req-5b4e23d5-d773-418f-ad14-7c7f528d3f8e None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  644.839395] env[69446]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5b4e23d5-d773-418f-ad14-7c7f528d3f8e None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  644.839539] env[69446]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5b4e23d5-d773-418f-ad14-7c7f528d3f8e None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=69446) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  646.840922] env[69446]: CRITICAL neutron [None req-5b4e23d5-d773-418f-ad14-7c7f528d3f8e None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  646.840922] env[69446]: ERROR neutron Traceback (most recent call last):
[  646.840922] env[69446]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  646.840922] env[69446]: ERROR neutron     sys.exit(main())
[  646.840922] env[69446]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  646.840922] env[69446]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  646.840922] env[69446]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  646.840922] env[69446]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  646.840922] env[69446]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  646.840922] env[69446]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  646.840922] env[69446]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  646.840922] env[69446]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  646.840922] env[69446]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  646.840922] env[69446]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  646.840922] env[69446]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  646.840922] env[69446]: ERROR neutron     response = self.get(path=path, params=params)
[  646.841611] env[69446]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  646.841611] env[69446]: ERROR neutron     raise RuntimeError(msg, last_err)
[  646.841611] env[69446]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  646.841611] env[69446]: ERROR neutron 
[  649.697615] env[69606]: INFO neutron.common.config [-] Logging enabled!
[  649.697878] env[69606]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  649.698138] env[69606]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=69606) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  649.698373] env[69606]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  649.698460] env[69606]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  649.699307] env[69606]: WARNING oslo_policy.policy [None req-b32ee504-b4cd-4d89-a84d-0ac0d21a27fb None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  649.699528] env[69606]: WARNING oslo_policy.policy [None req-b32ee504-b4cd-4d89-a84d-0ac0d21a27fb None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  649.700838] env[69606]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-b32ee504-b4cd-4d89-a84d-0ac0d21a27fb None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  649.715293] env[69606]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-b32ee504-b4cd-4d89-a84d-0ac0d21a27fb None None] Session token - acquiring
[  649.716119] env[69606]: DEBUG networking_nsxv3.common.locking [None req-b32ee504-b4cd-4d89-a84d-0ac0d21a27fb None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=69606) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  649.716328] env[69606]: DEBUG oslo_concurrency.lockutils [None req-b32ee504-b4cd-4d89-a84d-0ac0d21a27fb None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69606) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  649.716454] env[69606]: DEBUG oslo_concurrency.lockutils [None req-b32ee504-b4cd-4d89-a84d-0ac0d21a27fb None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69606) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  649.716823] env[69606]: DEBUG oslo_concurrency.lockutils [None req-b32ee504-b4cd-4d89-a84d-0ac0d21a27fb None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69606) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  649.725890] env[69606]: DEBUG oslo_concurrency.lockutils [None req-b32ee504-b4cd-4d89-a84d-0ac0d21a27fb None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69606) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  649.726221] env[69606]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-b32ee504-b4cd-4d89-a84d-0ac0d21a27fb None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  649.726387] env[69606]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-b32ee504-b4cd-4d89-a84d-0ac0d21a27fb None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=69606) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  651.732555] env[69606]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-b32ee504-b4cd-4d89-a84d-0ac0d21a27fb None None] Session token - acquiring
[  651.732927] env[69606]: DEBUG networking_nsxv3.common.locking [None req-b32ee504-b4cd-4d89-a84d-0ac0d21a27fb None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=69606) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  651.733023] env[69606]: DEBUG oslo_concurrency.lockutils [None req-b32ee504-b4cd-4d89-a84d-0ac0d21a27fb None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69606) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  651.733143] env[69606]: DEBUG oslo_concurrency.lockutils [None req-b32ee504-b4cd-4d89-a84d-0ac0d21a27fb None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69606) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  651.733426] env[69606]: DEBUG oslo_concurrency.lockutils [None req-b32ee504-b4cd-4d89-a84d-0ac0d21a27fb None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69606) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  651.742748] env[69606]: DEBUG oslo_concurrency.lockutils [None req-b32ee504-b4cd-4d89-a84d-0ac0d21a27fb None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69606) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  651.742996] env[69606]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-b32ee504-b4cd-4d89-a84d-0ac0d21a27fb None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  651.743139] env[69606]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-b32ee504-b4cd-4d89-a84d-0ac0d21a27fb None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=69606) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  653.744885] env[69606]: CRITICAL neutron [None req-b32ee504-b4cd-4d89-a84d-0ac0d21a27fb None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  653.744885] env[69606]: ERROR neutron Traceback (most recent call last):
[  653.744885] env[69606]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  653.744885] env[69606]: ERROR neutron     sys.exit(main())
[  653.744885] env[69606]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  653.744885] env[69606]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  653.744885] env[69606]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  653.744885] env[69606]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  653.744885] env[69606]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  653.744885] env[69606]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  653.744885] env[69606]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  653.744885] env[69606]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  653.744885] env[69606]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  653.744885] env[69606]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  653.744885] env[69606]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  653.744885] env[69606]: ERROR neutron     response = self.get(path=path, params=params)
[  653.745513] env[69606]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  653.745513] env[69606]: ERROR neutron     raise RuntimeError(msg, last_err)
[  653.745513] env[69606]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  653.745513] env[69606]: ERROR neutron 
[  656.699438] env[69847]: INFO neutron.common.config [-] Logging enabled!
[  656.699778] env[69847]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  656.700093] env[69847]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=69847) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  656.700873] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  656.700873] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  656.701537] env[69847]: WARNING oslo_policy.policy [None req-e56c7d9f-3835-4a23-bb37-132960718bda None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  656.701537] env[69847]: WARNING oslo_policy.policy [None req-e56c7d9f-3835-4a23-bb37-132960718bda None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  656.702687] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-e56c7d9f-3835-4a23-bb37-132960718bda None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  656.720052] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e56c7d9f-3835-4a23-bb37-132960718bda None None] Session token - acquiring
[  656.720052] env[69847]: DEBUG networking_nsxv3.common.locking [None req-e56c7d9f-3835-4a23-bb37-132960718bda None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  656.720052] env[69847]: DEBUG oslo_concurrency.lockutils [None req-e56c7d9f-3835-4a23-bb37-132960718bda None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  656.720334] env[69847]: DEBUG oslo_concurrency.lockutils [None req-e56c7d9f-3835-4a23-bb37-132960718bda None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  656.720334] env[69847]: DEBUG oslo_concurrency.lockutils [None req-e56c7d9f-3835-4a23-bb37-132960718bda None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  656.729077] env[69847]: DEBUG oslo_concurrency.lockutils [None req-e56c7d9f-3835-4a23-bb37-132960718bda None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  656.729077] env[69847]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e56c7d9f-3835-4a23-bb37-132960718bda None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  656.729077] env[69847]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e56c7d9f-3835-4a23-bb37-132960718bda None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=69847) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  658.736503] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e56c7d9f-3835-4a23-bb37-132960718bda None None] Session token - acquiring
[  658.736833] env[69847]: DEBUG networking_nsxv3.common.locking [None req-e56c7d9f-3835-4a23-bb37-132960718bda None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  658.736983] env[69847]: DEBUG oslo_concurrency.lockutils [None req-e56c7d9f-3835-4a23-bb37-132960718bda None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  658.737106] env[69847]: DEBUG oslo_concurrency.lockutils [None req-e56c7d9f-3835-4a23-bb37-132960718bda None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  658.737387] env[69847]: DEBUG oslo_concurrency.lockutils [None req-e56c7d9f-3835-4a23-bb37-132960718bda None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  658.762151] env[69847]: DEBUG oslo_concurrency.lockutils [None req-e56c7d9f-3835-4a23-bb37-132960718bda None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  658.762395] env[69847]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e56c7d9f-3835-4a23-bb37-132960718bda None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  658.762662] env[69847]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e56c7d9f-3835-4a23-bb37-132960718bda None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=69847) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  660.765717] env[69847]: CRITICAL neutron [None req-e56c7d9f-3835-4a23-bb37-132960718bda None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  660.765717] env[69847]: ERROR neutron Traceback (most recent call last):
[  660.765717] env[69847]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  660.765717] env[69847]: ERROR neutron     sys.exit(main())
[  660.765717] env[69847]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  660.765717] env[69847]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  660.765717] env[69847]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  660.765717] env[69847]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  660.765717] env[69847]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  660.765717] env[69847]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  660.765717] env[69847]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  660.765717] env[69847]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  660.765717] env[69847]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  660.765717] env[69847]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  660.765717] env[69847]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  660.765717] env[69847]: ERROR neutron     response = self.get(path=path, params=params)
[  660.766473] env[69847]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  660.766473] env[69847]: ERROR neutron     raise RuntimeError(msg, last_err)
[  660.766473] env[69847]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  660.766473] env[69847]: ERROR neutron 
[  663.269909] env[70190]: INFO neutron.common.config [-] Logging enabled!
[  663.270119] env[70190]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  663.270427] env[70190]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=70190) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  663.270651] env[70190]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  663.270739] env[70190]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  663.271572] env[70190]: WARNING oslo_policy.policy [None req-aa94bb97-8cfb-4310-ac7a-0717fd5eea08 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  663.271786] env[70190]: WARNING oslo_policy.policy [None req-aa94bb97-8cfb-4310-ac7a-0717fd5eea08 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  663.273057] env[70190]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-aa94bb97-8cfb-4310-ac7a-0717fd5eea08 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  663.287535] env[70190]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-aa94bb97-8cfb-4310-ac7a-0717fd5eea08 None None] Session token - acquiring
[  663.288819] env[70190]: DEBUG networking_nsxv3.common.locking [None req-aa94bb97-8cfb-4310-ac7a-0717fd5eea08 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=70190) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  663.289301] env[70190]: DEBUG oslo_concurrency.lockutils [None req-aa94bb97-8cfb-4310-ac7a-0717fd5eea08 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  663.289531] env[70190]: DEBUG oslo_concurrency.lockutils [None req-aa94bb97-8cfb-4310-ac7a-0717fd5eea08 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  663.289976] env[70190]: DEBUG oslo_concurrency.lockutils [None req-aa94bb97-8cfb-4310-ac7a-0717fd5eea08 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  663.300386] env[70190]: DEBUG oslo_concurrency.lockutils [None req-aa94bb97-8cfb-4310-ac7a-0717fd5eea08 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  663.300652] env[70190]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-aa94bb97-8cfb-4310-ac7a-0717fd5eea08 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  663.300808] env[70190]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-aa94bb97-8cfb-4310-ac7a-0717fd5eea08 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=70190) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  665.307156] env[70190]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-aa94bb97-8cfb-4310-ac7a-0717fd5eea08 None None] Session token - acquiring
[  665.307460] env[70190]: DEBUG networking_nsxv3.common.locking [None req-aa94bb97-8cfb-4310-ac7a-0717fd5eea08 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=70190) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  665.307655] env[70190]: DEBUG oslo_concurrency.lockutils [None req-aa94bb97-8cfb-4310-ac7a-0717fd5eea08 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  665.307798] env[70190]: DEBUG oslo_concurrency.lockutils [None req-aa94bb97-8cfb-4310-ac7a-0717fd5eea08 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  665.308097] env[70190]: DEBUG oslo_concurrency.lockutils [None req-aa94bb97-8cfb-4310-ac7a-0717fd5eea08 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  665.317419] env[70190]: DEBUG oslo_concurrency.lockutils [None req-aa94bb97-8cfb-4310-ac7a-0717fd5eea08 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  665.317662] env[70190]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-aa94bb97-8cfb-4310-ac7a-0717fd5eea08 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  665.317821] env[70190]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-aa94bb97-8cfb-4310-ac7a-0717fd5eea08 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=70190) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  667.320836] env[70190]: CRITICAL neutron [None req-aa94bb97-8cfb-4310-ac7a-0717fd5eea08 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  667.320836] env[70190]: ERROR neutron Traceback (most recent call last):
[  667.320836] env[70190]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  667.320836] env[70190]: ERROR neutron     sys.exit(main())
[  667.320836] env[70190]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  667.320836] env[70190]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  667.320836] env[70190]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  667.320836] env[70190]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  667.320836] env[70190]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  667.320836] env[70190]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  667.320836] env[70190]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  667.320836] env[70190]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  667.320836] env[70190]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  667.320836] env[70190]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  667.320836] env[70190]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  667.320836] env[70190]: ERROR neutron     response = self.get(path=path, params=params)
[  667.321908] env[70190]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  667.321908] env[70190]: ERROR neutron     raise RuntimeError(msg, last_err)
[  667.321908] env[70190]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  667.321908] env[70190]: ERROR neutron 
[  669.992334] env[70256]: INFO neutron.common.config [-] Logging enabled!
[  669.992678] env[70256]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  669.995429] env[70256]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=70256) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  669.995429] env[70256]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  669.995429] env[70256]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  669.995429] env[70256]: WARNING oslo_policy.policy [None req-52cbd353-1487-41cf-887e-e8b4fe0ab72e None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  669.995429] env[70256]: WARNING oslo_policy.policy [None req-52cbd353-1487-41cf-887e-e8b4fe0ab72e None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  669.995429] env[70256]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-52cbd353-1487-41cf-887e-e8b4fe0ab72e None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  670.015925] env[70256]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-52cbd353-1487-41cf-887e-e8b4fe0ab72e None None] Session token - acquiring
[  670.016900] env[70256]: DEBUG networking_nsxv3.common.locking [None req-52cbd353-1487-41cf-887e-e8b4fe0ab72e None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=70256) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  670.017181] env[70256]: DEBUG oslo_concurrency.lockutils [None req-52cbd353-1487-41cf-887e-e8b4fe0ab72e None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70256) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  670.017356] env[70256]: DEBUG oslo_concurrency.lockutils [None req-52cbd353-1487-41cf-887e-e8b4fe0ab72e None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70256) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  670.017830] env[70256]: DEBUG oslo_concurrency.lockutils [None req-52cbd353-1487-41cf-887e-e8b4fe0ab72e None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70256) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  670.031712] env[70256]: DEBUG oslo_concurrency.lockutils [None req-52cbd353-1487-41cf-887e-e8b4fe0ab72e None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70256) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  670.031979] env[70256]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-52cbd353-1487-41cf-887e-e8b4fe0ab72e None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  670.032254] env[70256]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-52cbd353-1487-41cf-887e-e8b4fe0ab72e None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=70256) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  672.038499] env[70256]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-52cbd353-1487-41cf-887e-e8b4fe0ab72e None None] Session token - acquiring
[  672.038786] env[70256]: DEBUG networking_nsxv3.common.locking [None req-52cbd353-1487-41cf-887e-e8b4fe0ab72e None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=70256) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  672.038906] env[70256]: DEBUG oslo_concurrency.lockutils [None req-52cbd353-1487-41cf-887e-e8b4fe0ab72e None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70256) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  672.039029] env[70256]: DEBUG oslo_concurrency.lockutils [None req-52cbd353-1487-41cf-887e-e8b4fe0ab72e None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70256) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  672.039300] env[70256]: DEBUG oslo_concurrency.lockutils [None req-52cbd353-1487-41cf-887e-e8b4fe0ab72e None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70256) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  672.050233] env[70256]: DEBUG oslo_concurrency.lockutils [None req-52cbd353-1487-41cf-887e-e8b4fe0ab72e None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70256) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  672.050483] env[70256]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-52cbd353-1487-41cf-887e-e8b4fe0ab72e None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  672.050622] env[70256]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-52cbd353-1487-41cf-887e-e8b4fe0ab72e None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=70256) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  674.052925] env[70256]: CRITICAL neutron [None req-52cbd353-1487-41cf-887e-e8b4fe0ab72e None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  674.052925] env[70256]: ERROR neutron Traceback (most recent call last):
[  674.052925] env[70256]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  674.052925] env[70256]: ERROR neutron     sys.exit(main())
[  674.052925] env[70256]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  674.052925] env[70256]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  674.052925] env[70256]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  674.052925] env[70256]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  674.052925] env[70256]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  674.052925] env[70256]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  674.052925] env[70256]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  674.052925] env[70256]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  674.052925] env[70256]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  674.052925] env[70256]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  674.052925] env[70256]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  674.052925] env[70256]: ERROR neutron     response = self.get(path=path, params=params)
[  674.053614] env[70256]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  674.053614] env[70256]: ERROR neutron     raise RuntimeError(msg, last_err)
[  674.053614] env[70256]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  674.053614] env[70256]: ERROR neutron 
[  676.900958] env[70376]: INFO neutron.common.config [-] Logging enabled!
[  676.901226] env[70376]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  676.901446] env[70376]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=70376) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  676.901680] env[70376]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  676.901776] env[70376]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  676.902646] env[70376]: WARNING oslo_policy.policy [None req-148fd5ee-b0da-41c1-b5b4-1f6026f6b01c None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  676.902848] env[70376]: WARNING oslo_policy.policy [None req-148fd5ee-b0da-41c1-b5b4-1f6026f6b01c None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  676.904104] env[70376]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-148fd5ee-b0da-41c1-b5b4-1f6026f6b01c None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  676.918624] env[70376]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-148fd5ee-b0da-41c1-b5b4-1f6026f6b01c None None] Session token - acquiring
[  676.919427] env[70376]: DEBUG networking_nsxv3.common.locking [None req-148fd5ee-b0da-41c1-b5b4-1f6026f6b01c None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=70376) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  676.919630] env[70376]: DEBUG oslo_concurrency.lockutils [None req-148fd5ee-b0da-41c1-b5b4-1f6026f6b01c None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70376) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  676.919755] env[70376]: DEBUG oslo_concurrency.lockutils [None req-148fd5ee-b0da-41c1-b5b4-1f6026f6b01c None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70376) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  676.921303] env[70376]: DEBUG oslo_concurrency.lockutils [None req-148fd5ee-b0da-41c1-b5b4-1f6026f6b01c None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70376) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  676.929467] env[70376]: DEBUG oslo_concurrency.lockutils [None req-148fd5ee-b0da-41c1-b5b4-1f6026f6b01c None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70376) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  676.929721] env[70376]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-148fd5ee-b0da-41c1-b5b4-1f6026f6b01c None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  676.929874] env[70376]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-148fd5ee-b0da-41c1-b5b4-1f6026f6b01c None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=70376) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  678.936588] env[70376]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-148fd5ee-b0da-41c1-b5b4-1f6026f6b01c None None] Session token - acquiring
[  678.937350] env[70376]: DEBUG networking_nsxv3.common.locking [None req-148fd5ee-b0da-41c1-b5b4-1f6026f6b01c None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=70376) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  678.937730] env[70376]: DEBUG oslo_concurrency.lockutils [None req-148fd5ee-b0da-41c1-b5b4-1f6026f6b01c None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70376) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  678.937956] env[70376]: DEBUG oslo_concurrency.lockutils [None req-148fd5ee-b0da-41c1-b5b4-1f6026f6b01c None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70376) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  678.938316] env[70376]: DEBUG oslo_concurrency.lockutils [None req-148fd5ee-b0da-41c1-b5b4-1f6026f6b01c None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70376) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  678.950187] env[70376]: DEBUG oslo_concurrency.lockutils [None req-148fd5ee-b0da-41c1-b5b4-1f6026f6b01c None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70376) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  678.950557] env[70376]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-148fd5ee-b0da-41c1-b5b4-1f6026f6b01c None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  678.950892] env[70376]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-148fd5ee-b0da-41c1-b5b4-1f6026f6b01c None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=70376) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  680.952955] env[70376]: CRITICAL neutron [None req-148fd5ee-b0da-41c1-b5b4-1f6026f6b01c None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  680.952955] env[70376]: ERROR neutron Traceback (most recent call last):
[  680.952955] env[70376]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  680.952955] env[70376]: ERROR neutron     sys.exit(main())
[  680.952955] env[70376]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  680.952955] env[70376]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  680.952955] env[70376]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  680.952955] env[70376]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  680.952955] env[70376]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  680.952955] env[70376]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  680.952955] env[70376]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  680.952955] env[70376]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  680.952955] env[70376]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  680.952955] env[70376]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  680.952955] env[70376]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  680.952955] env[70376]: ERROR neutron     response = self.get(path=path, params=params)
[  680.953858] env[70376]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  680.953858] env[70376]: ERROR neutron     raise RuntimeError(msg, last_err)
[  680.953858] env[70376]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  680.953858] env[70376]: ERROR neutron 
[  683.665618] env[70579]: INFO neutron.common.config [-] Logging enabled!
[  683.665971] env[70579]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  683.666138] env[70579]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=70579) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  683.666365] env[70579]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  683.666457] env[70579]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  683.667283] env[70579]: WARNING oslo_policy.policy [None req-8e6f258f-ec0c-4e02-bc49-6980f4a24a1f None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  683.667498] env[70579]: WARNING oslo_policy.policy [None req-8e6f258f-ec0c-4e02-bc49-6980f4a24a1f None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  683.668743] env[70579]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-8e6f258f-ec0c-4e02-bc49-6980f4a24a1f None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  683.683377] env[70579]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-8e6f258f-ec0c-4e02-bc49-6980f4a24a1f None None] Session token - acquiring
[  683.684318] env[70579]: DEBUG networking_nsxv3.common.locking [None req-8e6f258f-ec0c-4e02-bc49-6980f4a24a1f None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=70579) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  683.684519] env[70579]: DEBUG oslo_concurrency.lockutils [None req-8e6f258f-ec0c-4e02-bc49-6980f4a24a1f None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70579) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  683.684643] env[70579]: DEBUG oslo_concurrency.lockutils [None req-8e6f258f-ec0c-4e02-bc49-6980f4a24a1f None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70579) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  683.685017] env[70579]: DEBUG oslo_concurrency.lockutils [None req-8e6f258f-ec0c-4e02-bc49-6980f4a24a1f None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70579) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  683.698461] env[70579]: DEBUG oslo_concurrency.lockutils [None req-8e6f258f-ec0c-4e02-bc49-6980f4a24a1f None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70579) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  683.698551] env[70579]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-8e6f258f-ec0c-4e02-bc49-6980f4a24a1f None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  683.698649] env[70579]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-8e6f258f-ec0c-4e02-bc49-6980f4a24a1f None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=70579) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  685.704881] env[70579]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-8e6f258f-ec0c-4e02-bc49-6980f4a24a1f None None] Session token - acquiring
[  685.705306] env[70579]: DEBUG networking_nsxv3.common.locking [None req-8e6f258f-ec0c-4e02-bc49-6980f4a24a1f None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=70579) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  685.705849] env[70579]: DEBUG oslo_concurrency.lockutils [None req-8e6f258f-ec0c-4e02-bc49-6980f4a24a1f None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70579) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  685.705849] env[70579]: DEBUG oslo_concurrency.lockutils [None req-8e6f258f-ec0c-4e02-bc49-6980f4a24a1f None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70579) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  685.705849] env[70579]: DEBUG oslo_concurrency.lockutils [None req-8e6f258f-ec0c-4e02-bc49-6980f4a24a1f None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70579) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  685.715013] env[70579]: DEBUG oslo_concurrency.lockutils [None req-8e6f258f-ec0c-4e02-bc49-6980f4a24a1f None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70579) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  685.715255] env[70579]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-8e6f258f-ec0c-4e02-bc49-6980f4a24a1f None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  685.715393] env[70579]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-8e6f258f-ec0c-4e02-bc49-6980f4a24a1f None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=70579) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  687.717150] env[70579]: CRITICAL neutron [None req-8e6f258f-ec0c-4e02-bc49-6980f4a24a1f None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  687.717150] env[70579]: ERROR neutron Traceback (most recent call last):
[  687.717150] env[70579]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  687.717150] env[70579]: ERROR neutron     sys.exit(main())
[  687.717150] env[70579]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  687.717150] env[70579]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  687.717150] env[70579]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  687.717150] env[70579]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  687.717150] env[70579]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  687.717150] env[70579]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  687.717150] env[70579]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  687.717150] env[70579]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  687.717150] env[70579]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  687.717150] env[70579]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  687.717150] env[70579]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  687.717150] env[70579]: ERROR neutron     response = self.get(path=path, params=params)
[  687.717803] env[70579]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  687.717803] env[70579]: ERROR neutron     raise RuntimeError(msg, last_err)
[  687.717803] env[70579]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  687.717803] env[70579]: ERROR neutron 
[  690.285508] env[70776]: INFO neutron.common.config [-] Logging enabled!
[  690.285842] env[70776]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  690.286053] env[70776]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=70776) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  690.286317] env[70776]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  690.286434] env[70776]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  690.287283] env[70776]: WARNING oslo_policy.policy [None req-53ef5512-6298-46a3-9d5e-6548eb077622 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  690.287527] env[70776]: WARNING oslo_policy.policy [None req-53ef5512-6298-46a3-9d5e-6548eb077622 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  690.288782] env[70776]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-53ef5512-6298-46a3-9d5e-6548eb077622 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  690.303298] env[70776]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-53ef5512-6298-46a3-9d5e-6548eb077622 None None] Session token - acquiring
[  690.304120] env[70776]: DEBUG networking_nsxv3.common.locking [None req-53ef5512-6298-46a3-9d5e-6548eb077622 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=70776) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  690.304334] env[70776]: DEBUG oslo_concurrency.lockutils [None req-53ef5512-6298-46a3-9d5e-6548eb077622 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  690.304462] env[70776]: DEBUG oslo_concurrency.lockutils [None req-53ef5512-6298-46a3-9d5e-6548eb077622 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  690.304826] env[70776]: DEBUG oslo_concurrency.lockutils [None req-53ef5512-6298-46a3-9d5e-6548eb077622 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  690.313884] env[70776]: DEBUG oslo_concurrency.lockutils [None req-53ef5512-6298-46a3-9d5e-6548eb077622 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  690.314138] env[70776]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-53ef5512-6298-46a3-9d5e-6548eb077622 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  690.314288] env[70776]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-53ef5512-6298-46a3-9d5e-6548eb077622 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=70776) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  692.321001] env[70776]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-53ef5512-6298-46a3-9d5e-6548eb077622 None None] Session token - acquiring
[  692.321231] env[70776]: DEBUG networking_nsxv3.common.locking [None req-53ef5512-6298-46a3-9d5e-6548eb077622 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=70776) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  692.321446] env[70776]: DEBUG oslo_concurrency.lockutils [None req-53ef5512-6298-46a3-9d5e-6548eb077622 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  692.321612] env[70776]: DEBUG oslo_concurrency.lockutils [None req-53ef5512-6298-46a3-9d5e-6548eb077622 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  692.321851] env[70776]: DEBUG oslo_concurrency.lockutils [None req-53ef5512-6298-46a3-9d5e-6548eb077622 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  692.331201] env[70776]: DEBUG oslo_concurrency.lockutils [None req-53ef5512-6298-46a3-9d5e-6548eb077622 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  692.331443] env[70776]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-53ef5512-6298-46a3-9d5e-6548eb077622 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  692.331579] env[70776]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-53ef5512-6298-46a3-9d5e-6548eb077622 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=70776) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  694.332922] env[70776]: CRITICAL neutron [None req-53ef5512-6298-46a3-9d5e-6548eb077622 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  694.332922] env[70776]: ERROR neutron Traceback (most recent call last):
[  694.332922] env[70776]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  694.332922] env[70776]: ERROR neutron     sys.exit(main())
[  694.332922] env[70776]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  694.332922] env[70776]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  694.332922] env[70776]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  694.332922] env[70776]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  694.332922] env[70776]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  694.332922] env[70776]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  694.332922] env[70776]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  694.332922] env[70776]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  694.332922] env[70776]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  694.332922] env[70776]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  694.332922] env[70776]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  694.332922] env[70776]: ERROR neutron     response = self.get(path=path, params=params)
[  694.333616] env[70776]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  694.333616] env[70776]: ERROR neutron     raise RuntimeError(msg, last_err)
[  694.333616] env[70776]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  694.333616] env[70776]: ERROR neutron 
[  697.093848] env[70887]: INFO neutron.common.config [-] Logging enabled!
[  697.094192] env[70887]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  697.094408] env[70887]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=70887) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  697.094653] env[70887]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  697.094744] env[70887]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  697.095666] env[70887]: WARNING oslo_policy.policy [None req-c4e79413-e2eb-4cc3-a616-f9041c31c5fc None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  697.095894] env[70887]: WARNING oslo_policy.policy [None req-c4e79413-e2eb-4cc3-a616-f9041c31c5fc None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  697.097255] env[70887]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-c4e79413-e2eb-4cc3-a616-f9041c31c5fc None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  697.112728] env[70887]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-c4e79413-e2eb-4cc3-a616-f9041c31c5fc None None] Session token - acquiring
[  697.113617] env[70887]: DEBUG networking_nsxv3.common.locking [None req-c4e79413-e2eb-4cc3-a616-f9041c31c5fc None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=70887) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  697.113829] env[70887]: DEBUG oslo_concurrency.lockutils [None req-c4e79413-e2eb-4cc3-a616-f9041c31c5fc None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70887) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  697.113977] env[70887]: DEBUG oslo_concurrency.lockutils [None req-c4e79413-e2eb-4cc3-a616-f9041c31c5fc None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70887) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  697.114874] env[70887]: DEBUG oslo_concurrency.lockutils [None req-c4e79413-e2eb-4cc3-a616-f9041c31c5fc None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70887) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  697.129344] env[70887]: DEBUG oslo_concurrency.lockutils [None req-c4e79413-e2eb-4cc3-a616-f9041c31c5fc None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70887) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  697.129635] env[70887]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-c4e79413-e2eb-4cc3-a616-f9041c31c5fc None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  697.129788] env[70887]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-c4e79413-e2eb-4cc3-a616-f9041c31c5fc None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=70887) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  699.138028] env[70887]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-c4e79413-e2eb-4cc3-a616-f9041c31c5fc None None] Session token - acquiring
[  699.138376] env[70887]: DEBUG networking_nsxv3.common.locking [None req-c4e79413-e2eb-4cc3-a616-f9041c31c5fc None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=70887) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  699.138555] env[70887]: DEBUG oslo_concurrency.lockutils [None req-c4e79413-e2eb-4cc3-a616-f9041c31c5fc None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70887) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  699.138706] env[70887]: DEBUG oslo_concurrency.lockutils [None req-c4e79413-e2eb-4cc3-a616-f9041c31c5fc None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70887) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  699.138958] env[70887]: DEBUG oslo_concurrency.lockutils [None req-c4e79413-e2eb-4cc3-a616-f9041c31c5fc None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70887) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  699.148010] env[70887]: DEBUG oslo_concurrency.lockutils [None req-c4e79413-e2eb-4cc3-a616-f9041c31c5fc None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70887) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  699.148277] env[70887]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-c4e79413-e2eb-4cc3-a616-f9041c31c5fc None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  699.148644] env[70887]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-c4e79413-e2eb-4cc3-a616-f9041c31c5fc None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=70887) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  701.151354] env[70887]: CRITICAL neutron [None req-c4e79413-e2eb-4cc3-a616-f9041c31c5fc None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  701.151354] env[70887]: ERROR neutron Traceback (most recent call last):
[  701.151354] env[70887]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  701.151354] env[70887]: ERROR neutron     sys.exit(main())
[  701.151354] env[70887]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  701.151354] env[70887]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  701.151354] env[70887]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  701.151354] env[70887]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  701.151354] env[70887]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  701.151354] env[70887]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  701.151354] env[70887]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  701.151354] env[70887]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  701.151354] env[70887]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  701.151354] env[70887]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  701.151354] env[70887]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  701.151354] env[70887]: ERROR neutron     response = self.get(path=path, params=params)
[  701.152115] env[70887]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  701.152115] env[70887]: ERROR neutron     raise RuntimeError(msg, last_err)
[  701.152115] env[70887]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  701.152115] env[70887]: ERROR neutron 
[  704.072833] env[70989]: INFO neutron.common.config [-] Logging enabled!
[  704.073076] env[70989]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  704.073383] env[70989]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=70989) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  704.073614] env[70989]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  704.073788] env[70989]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  704.074584] env[70989]: WARNING oslo_policy.policy [None req-2bb208ac-789f-4bf2-8a14-6ef511b6ea8c None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  704.074812] env[70989]: WARNING oslo_policy.policy [None req-2bb208ac-789f-4bf2-8a14-6ef511b6ea8c None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  704.076277] env[70989]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-2bb208ac-789f-4bf2-8a14-6ef511b6ea8c None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  704.091312] env[70989]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-2bb208ac-789f-4bf2-8a14-6ef511b6ea8c None None] Session token - acquiring
[  704.092816] env[70989]: DEBUG networking_nsxv3.common.locking [None req-2bb208ac-789f-4bf2-8a14-6ef511b6ea8c None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=70989) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  704.093207] env[70989]: DEBUG oslo_concurrency.lockutils [None req-2bb208ac-789f-4bf2-8a14-6ef511b6ea8c None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70989) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  704.093346] env[70989]: DEBUG oslo_concurrency.lockutils [None req-2bb208ac-789f-4bf2-8a14-6ef511b6ea8c None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70989) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  704.094443] env[70989]: DEBUG oslo_concurrency.lockutils [None req-2bb208ac-789f-4bf2-8a14-6ef511b6ea8c None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70989) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  704.104665] env[70989]: DEBUG oslo_concurrency.lockutils [None req-2bb208ac-789f-4bf2-8a14-6ef511b6ea8c None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70989) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  704.104932] env[70989]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-2bb208ac-789f-4bf2-8a14-6ef511b6ea8c None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  704.105084] env[70989]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-2bb208ac-789f-4bf2-8a14-6ef511b6ea8c None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=70989) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  706.111098] env[70989]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-2bb208ac-789f-4bf2-8a14-6ef511b6ea8c None None] Session token - acquiring
[  706.111606] env[70989]: DEBUG networking_nsxv3.common.locking [None req-2bb208ac-789f-4bf2-8a14-6ef511b6ea8c None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=70989) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  706.111960] env[70989]: DEBUG oslo_concurrency.lockutils [None req-2bb208ac-789f-4bf2-8a14-6ef511b6ea8c None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70989) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  706.111960] env[70989]: DEBUG oslo_concurrency.lockutils [None req-2bb208ac-789f-4bf2-8a14-6ef511b6ea8c None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70989) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  706.112224] env[70989]: DEBUG oslo_concurrency.lockutils [None req-2bb208ac-789f-4bf2-8a14-6ef511b6ea8c None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70989) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  706.121320] env[70989]: DEBUG oslo_concurrency.lockutils [None req-2bb208ac-789f-4bf2-8a14-6ef511b6ea8c None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70989) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  706.121578] env[70989]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-2bb208ac-789f-4bf2-8a14-6ef511b6ea8c None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  706.121718] env[70989]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-2bb208ac-789f-4bf2-8a14-6ef511b6ea8c None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=70989) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  708.124701] env[70989]: CRITICAL neutron [None req-2bb208ac-789f-4bf2-8a14-6ef511b6ea8c None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  708.124701] env[70989]: ERROR neutron Traceback (most recent call last):
[  708.124701] env[70989]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  708.124701] env[70989]: ERROR neutron     sys.exit(main())
[  708.124701] env[70989]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  708.124701] env[70989]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  708.124701] env[70989]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  708.124701] env[70989]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  708.124701] env[70989]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  708.124701] env[70989]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  708.124701] env[70989]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  708.124701] env[70989]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  708.124701] env[70989]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  708.124701] env[70989]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  708.124701] env[70989]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  708.124701] env[70989]: ERROR neutron     response = self.get(path=path, params=params)
[  708.125470] env[70989]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  708.125470] env[70989]: ERROR neutron     raise RuntimeError(msg, last_err)
[  708.125470] env[70989]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  708.125470] env[70989]: ERROR neutron 
[  710.842385] env[71357]: INFO neutron.common.config [-] Logging enabled!
[  710.842626] env[71357]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  710.842918] env[71357]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=71357) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  710.843144] env[71357]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  710.843238] env[71357]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  710.844243] env[71357]: WARNING oslo_policy.policy [None req-0b112da9-e3b6-4099-a046-a5b2106786b4 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  710.844529] env[71357]: WARNING oslo_policy.policy [None req-0b112da9-e3b6-4099-a046-a5b2106786b4 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  710.845756] env[71357]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-0b112da9-e3b6-4099-a046-a5b2106786b4 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  710.866978] env[71357]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-0b112da9-e3b6-4099-a046-a5b2106786b4 None None] Session token - acquiring
[  710.867837] env[71357]: DEBUG networking_nsxv3.common.locking [None req-0b112da9-e3b6-4099-a046-a5b2106786b4 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=71357) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  710.868050] env[71357]: DEBUG oslo_concurrency.lockutils [None req-0b112da9-e3b6-4099-a046-a5b2106786b4 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71357) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  710.868433] env[71357]: DEBUG oslo_concurrency.lockutils [None req-0b112da9-e3b6-4099-a046-a5b2106786b4 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71357) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  710.868580] env[71357]: DEBUG oslo_concurrency.lockutils [None req-0b112da9-e3b6-4099-a046-a5b2106786b4 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71357) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  710.877779] env[71357]: DEBUG oslo_concurrency.lockutils [None req-0b112da9-e3b6-4099-a046-a5b2106786b4 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71357) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  710.878044] env[71357]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-0b112da9-e3b6-4099-a046-a5b2106786b4 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  710.878198] env[71357]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-0b112da9-e3b6-4099-a046-a5b2106786b4 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=71357) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  712.884266] env[71357]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-0b112da9-e3b6-4099-a046-a5b2106786b4 None None] Session token - acquiring
[  712.884558] env[71357]: DEBUG networking_nsxv3.common.locking [None req-0b112da9-e3b6-4099-a046-a5b2106786b4 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=71357) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  712.884737] env[71357]: DEBUG oslo_concurrency.lockutils [None req-0b112da9-e3b6-4099-a046-a5b2106786b4 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71357) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  712.884860] env[71357]: DEBUG oslo_concurrency.lockutils [None req-0b112da9-e3b6-4099-a046-a5b2106786b4 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71357) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  712.885265] env[71357]: DEBUG oslo_concurrency.lockutils [None req-0b112da9-e3b6-4099-a046-a5b2106786b4 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71357) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  712.893911] env[71357]: DEBUG oslo_concurrency.lockutils [None req-0b112da9-e3b6-4099-a046-a5b2106786b4 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71357) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  712.894155] env[71357]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-0b112da9-e3b6-4099-a046-a5b2106786b4 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  712.894291] env[71357]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-0b112da9-e3b6-4099-a046-a5b2106786b4 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=71357) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  714.904042] env[71357]: CRITICAL neutron [None req-0b112da9-e3b6-4099-a046-a5b2106786b4 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  714.904042] env[71357]: ERROR neutron Traceback (most recent call last):
[  714.904042] env[71357]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  714.904042] env[71357]: ERROR neutron     sys.exit(main())
[  714.904042] env[71357]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  714.904042] env[71357]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  714.904042] env[71357]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  714.904042] env[71357]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  714.904042] env[71357]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  714.904042] env[71357]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  714.904042] env[71357]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  714.904042] env[71357]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  714.904042] env[71357]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  714.904042] env[71357]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  714.904042] env[71357]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  714.904042] env[71357]: ERROR neutron     response = self.get(path=path, params=params)
[  714.904884] env[71357]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  714.904884] env[71357]: ERROR neutron     raise RuntimeError(msg, last_err)
[  714.904884] env[71357]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  714.904884] env[71357]: ERROR neutron 
[  717.537776] env[71714]: INFO neutron.common.config [-] Logging enabled!
[  717.538124] env[71714]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  717.538567] env[71714]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=71714) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  717.538567] env[71714]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  717.538724] env[71714]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  717.539532] env[71714]: WARNING oslo_policy.policy [None req-ab7610e3-b1b6-4e92-b5f1-6d096330b051 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  717.539825] env[71714]: WARNING oslo_policy.policy [None req-ab7610e3-b1b6-4e92-b5f1-6d096330b051 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  717.541142] env[71714]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-ab7610e3-b1b6-4e92-b5f1-6d096330b051 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  717.567343] env[71714]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ab7610e3-b1b6-4e92-b5f1-6d096330b051 None None] Session token - acquiring
[  717.568560] env[71714]: DEBUG networking_nsxv3.common.locking [None req-ab7610e3-b1b6-4e92-b5f1-6d096330b051 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=71714) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  717.568785] env[71714]: DEBUG oslo_concurrency.lockutils [None req-ab7610e3-b1b6-4e92-b5f1-6d096330b051 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71714) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  717.568901] env[71714]: DEBUG oslo_concurrency.lockutils [None req-ab7610e3-b1b6-4e92-b5f1-6d096330b051 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71714) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  717.569321] env[71714]: DEBUG oslo_concurrency.lockutils [None req-ab7610e3-b1b6-4e92-b5f1-6d096330b051 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71714) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  717.579015] env[71714]: DEBUG oslo_concurrency.lockutils [None req-ab7610e3-b1b6-4e92-b5f1-6d096330b051 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71714) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  717.579789] env[71714]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ab7610e3-b1b6-4e92-b5f1-6d096330b051 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  717.580034] env[71714]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ab7610e3-b1b6-4e92-b5f1-6d096330b051 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=71714) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  719.588335] env[71714]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ab7610e3-b1b6-4e92-b5f1-6d096330b051 None None] Session token - acquiring
[  719.588335] env[71714]: DEBUG networking_nsxv3.common.locking [None req-ab7610e3-b1b6-4e92-b5f1-6d096330b051 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=71714) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  719.588335] env[71714]: DEBUG oslo_concurrency.lockutils [None req-ab7610e3-b1b6-4e92-b5f1-6d096330b051 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71714) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  719.588645] env[71714]: DEBUG oslo_concurrency.lockutils [None req-ab7610e3-b1b6-4e92-b5f1-6d096330b051 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71714) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  719.588645] env[71714]: DEBUG oslo_concurrency.lockutils [None req-ab7610e3-b1b6-4e92-b5f1-6d096330b051 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71714) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  719.599611] env[71714]: DEBUG oslo_concurrency.lockutils [None req-ab7610e3-b1b6-4e92-b5f1-6d096330b051 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71714) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  719.599611] env[71714]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ab7610e3-b1b6-4e92-b5f1-6d096330b051 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  719.599611] env[71714]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ab7610e3-b1b6-4e92-b5f1-6d096330b051 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=71714) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  721.602205] env[71714]: CRITICAL neutron [None req-ab7610e3-b1b6-4e92-b5f1-6d096330b051 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  721.602205] env[71714]: ERROR neutron Traceback (most recent call last):
[  721.602205] env[71714]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  721.602205] env[71714]: ERROR neutron     sys.exit(main())
[  721.602205] env[71714]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  721.602205] env[71714]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  721.602205] env[71714]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  721.602205] env[71714]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  721.602205] env[71714]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  721.602205] env[71714]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  721.602205] env[71714]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  721.602205] env[71714]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  721.602205] env[71714]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  721.602205] env[71714]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  721.602205] env[71714]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  721.602205] env[71714]: ERROR neutron     response = self.get(path=path, params=params)
[  721.602981] env[71714]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  721.602981] env[71714]: ERROR neutron     raise RuntimeError(msg, last_err)
[  721.602981] env[71714]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  721.602981] env[71714]: ERROR neutron 
[  724.256048] env[71933]: INFO neutron.common.config [-] Logging enabled!
[  724.256385] env[71933]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  724.256600] env[71933]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=71933) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  724.256836] env[71933]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  724.256933] env[71933]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  724.257789] env[71933]: WARNING oslo_policy.policy [None req-42e4f206-490f-4c7b-9a60-cebefecba149 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  724.258013] env[71933]: WARNING oslo_policy.policy [None req-42e4f206-490f-4c7b-9a60-cebefecba149 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  724.259241] env[71933]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-42e4f206-490f-4c7b-9a60-cebefecba149 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  724.274403] env[71933]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-42e4f206-490f-4c7b-9a60-cebefecba149 None None] Session token - acquiring
[  724.275320] env[71933]: DEBUG networking_nsxv3.common.locking [None req-42e4f206-490f-4c7b-9a60-cebefecba149 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=71933) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  724.275475] env[71933]: DEBUG oslo_concurrency.lockutils [None req-42e4f206-490f-4c7b-9a60-cebefecba149 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  724.275605] env[71933]: DEBUG oslo_concurrency.lockutils [None req-42e4f206-490f-4c7b-9a60-cebefecba149 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  724.275981] env[71933]: DEBUG oslo_concurrency.lockutils [None req-42e4f206-490f-4c7b-9a60-cebefecba149 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  724.285924] env[71933]: DEBUG oslo_concurrency.lockutils [None req-42e4f206-490f-4c7b-9a60-cebefecba149 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  724.291170] env[71933]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-42e4f206-490f-4c7b-9a60-cebefecba149 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  724.291170] env[71933]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-42e4f206-490f-4c7b-9a60-cebefecba149 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=71933) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  726.293129] env[71933]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-42e4f206-490f-4c7b-9a60-cebefecba149 None None] Session token - acquiring
[  726.293539] env[71933]: DEBUG networking_nsxv3.common.locking [None req-42e4f206-490f-4c7b-9a60-cebefecba149 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=71933) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  726.293746] env[71933]: DEBUG oslo_concurrency.lockutils [None req-42e4f206-490f-4c7b-9a60-cebefecba149 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  726.293868] env[71933]: DEBUG oslo_concurrency.lockutils [None req-42e4f206-490f-4c7b-9a60-cebefecba149 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  726.294136] env[71933]: DEBUG oslo_concurrency.lockutils [None req-42e4f206-490f-4c7b-9a60-cebefecba149 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  726.303803] env[71933]: DEBUG oslo_concurrency.lockutils [None req-42e4f206-490f-4c7b-9a60-cebefecba149 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  726.303982] env[71933]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-42e4f206-490f-4c7b-9a60-cebefecba149 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  726.304139] env[71933]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-42e4f206-490f-4c7b-9a60-cebefecba149 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=71933) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  728.307016] env[71933]: CRITICAL neutron [None req-42e4f206-490f-4c7b-9a60-cebefecba149 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  728.307016] env[71933]: ERROR neutron Traceback (most recent call last):
[  728.307016] env[71933]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  728.307016] env[71933]: ERROR neutron     sys.exit(main())
[  728.307016] env[71933]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  728.307016] env[71933]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  728.307016] env[71933]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  728.307016] env[71933]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  728.307016] env[71933]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  728.307016] env[71933]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  728.307016] env[71933]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  728.307016] env[71933]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  728.307016] env[71933]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  728.307016] env[71933]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  728.307016] env[71933]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  728.307016] env[71933]: ERROR neutron     response = self.get(path=path, params=params)
[  728.307682] env[71933]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  728.307682] env[71933]: ERROR neutron     raise RuntimeError(msg, last_err)
[  728.307682] env[71933]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  728.307682] env[71933]: ERROR neutron 
[  731.145917] env[72051]: INFO neutron.common.config [-] Logging enabled!
[  731.146149] env[72051]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  731.146471] env[72051]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=72051) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  731.146731] env[72051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  731.146821] env[72051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  731.147675] env[72051]: WARNING oslo_policy.policy [None req-8f12d8e2-e2da-4434-b6cb-aff0bc344dac None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  731.147893] env[72051]: WARNING oslo_policy.policy [None req-8f12d8e2-e2da-4434-b6cb-aff0bc344dac None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  731.149216] env[72051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-8f12d8e2-e2da-4434-b6cb-aff0bc344dac None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  731.163723] env[72051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-8f12d8e2-e2da-4434-b6cb-aff0bc344dac None None] Session token - acquiring
[  731.164527] env[72051]: DEBUG networking_nsxv3.common.locking [None req-8f12d8e2-e2da-4434-b6cb-aff0bc344dac None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=72051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  731.164729] env[72051]: DEBUG oslo_concurrency.lockutils [None req-8f12d8e2-e2da-4434-b6cb-aff0bc344dac None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  731.164860] env[72051]: DEBUG oslo_concurrency.lockutils [None req-8f12d8e2-e2da-4434-b6cb-aff0bc344dac None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  731.165343] env[72051]: DEBUG oslo_concurrency.lockutils [None req-8f12d8e2-e2da-4434-b6cb-aff0bc344dac None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  731.174899] env[72051]: DEBUG oslo_concurrency.lockutils [None req-8f12d8e2-e2da-4434-b6cb-aff0bc344dac None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  731.175177] env[72051]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-8f12d8e2-e2da-4434-b6cb-aff0bc344dac None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  731.175334] env[72051]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-8f12d8e2-e2da-4434-b6cb-aff0bc344dac None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=72051) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  733.181344] env[72051]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-8f12d8e2-e2da-4434-b6cb-aff0bc344dac None None] Session token - acquiring
[  733.181747] env[72051]: DEBUG networking_nsxv3.common.locking [None req-8f12d8e2-e2da-4434-b6cb-aff0bc344dac None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=72051) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  733.181857] env[72051]: DEBUG oslo_concurrency.lockutils [None req-8f12d8e2-e2da-4434-b6cb-aff0bc344dac None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  733.181981] env[72051]: DEBUG oslo_concurrency.lockutils [None req-8f12d8e2-e2da-4434-b6cb-aff0bc344dac None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  733.182254] env[72051]: DEBUG oslo_concurrency.lockutils [None req-8f12d8e2-e2da-4434-b6cb-aff0bc344dac None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  733.191266] env[72051]: DEBUG oslo_concurrency.lockutils [None req-8f12d8e2-e2da-4434-b6cb-aff0bc344dac None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  733.191506] env[72051]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-8f12d8e2-e2da-4434-b6cb-aff0bc344dac None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  733.191643] env[72051]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-8f12d8e2-e2da-4434-b6cb-aff0bc344dac None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=72051) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  735.192891] env[72051]: CRITICAL neutron [None req-8f12d8e2-e2da-4434-b6cb-aff0bc344dac None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  735.192891] env[72051]: ERROR neutron Traceback (most recent call last):
[  735.192891] env[72051]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  735.192891] env[72051]: ERROR neutron     sys.exit(main())
[  735.192891] env[72051]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  735.192891] env[72051]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  735.192891] env[72051]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  735.192891] env[72051]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  735.192891] env[72051]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  735.192891] env[72051]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  735.192891] env[72051]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  735.192891] env[72051]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  735.192891] env[72051]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  735.192891] env[72051]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  735.192891] env[72051]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  735.192891] env[72051]: ERROR neutron     response = self.get(path=path, params=params)
[  735.193604] env[72051]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  735.193604] env[72051]: ERROR neutron     raise RuntimeError(msg, last_err)
[  735.193604] env[72051]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  735.193604] env[72051]: ERROR neutron 
[  737.829790] env[72332]: INFO neutron.common.config [-] Logging enabled!
[  737.830220] env[72332]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  737.830316] env[72332]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=72332) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  737.830573] env[72332]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  737.830670] env[72332]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  737.831525] env[72332]: WARNING oslo_policy.policy [None req-df79a30d-7580-40c2-b2bc-987c58714588 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  737.831751] env[72332]: WARNING oslo_policy.policy [None req-df79a30d-7580-40c2-b2bc-987c58714588 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  737.833109] env[72332]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-df79a30d-7580-40c2-b2bc-987c58714588 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  737.847373] env[72332]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-df79a30d-7580-40c2-b2bc-987c58714588 None None] Session token - acquiring
[  737.848198] env[72332]: DEBUG networking_nsxv3.common.locking [None req-df79a30d-7580-40c2-b2bc-987c58714588 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=72332) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  737.848408] env[72332]: DEBUG oslo_concurrency.lockutils [None req-df79a30d-7580-40c2-b2bc-987c58714588 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72332) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  737.848551] env[72332]: DEBUG oslo_concurrency.lockutils [None req-df79a30d-7580-40c2-b2bc-987c58714588 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72332) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  737.848941] env[72332]: DEBUG oslo_concurrency.lockutils [None req-df79a30d-7580-40c2-b2bc-987c58714588 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72332) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  737.858338] env[72332]: DEBUG oslo_concurrency.lockutils [None req-df79a30d-7580-40c2-b2bc-987c58714588 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72332) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  737.858636] env[72332]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-df79a30d-7580-40c2-b2bc-987c58714588 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  737.858795] env[72332]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-df79a30d-7580-40c2-b2bc-987c58714588 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=72332) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  739.865271] env[72332]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-df79a30d-7580-40c2-b2bc-987c58714588 None None] Session token - acquiring
[  739.865614] env[72332]: DEBUG networking_nsxv3.common.locking [None req-df79a30d-7580-40c2-b2bc-987c58714588 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=72332) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  739.865848] env[72332]: DEBUG oslo_concurrency.lockutils [None req-df79a30d-7580-40c2-b2bc-987c58714588 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72332) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  739.865982] env[72332]: DEBUG oslo_concurrency.lockutils [None req-df79a30d-7580-40c2-b2bc-987c58714588 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72332) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  739.866260] env[72332]: DEBUG oslo_concurrency.lockutils [None req-df79a30d-7580-40c2-b2bc-987c58714588 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72332) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  739.875540] env[72332]: DEBUG oslo_concurrency.lockutils [None req-df79a30d-7580-40c2-b2bc-987c58714588 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72332) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  739.875642] env[72332]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-df79a30d-7580-40c2-b2bc-987c58714588 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  739.875739] env[72332]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-df79a30d-7580-40c2-b2bc-987c58714588 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=72332) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  741.876891] env[72332]: CRITICAL neutron [None req-df79a30d-7580-40c2-b2bc-987c58714588 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  741.876891] env[72332]: ERROR neutron Traceback (most recent call last):
[  741.876891] env[72332]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  741.876891] env[72332]: ERROR neutron     sys.exit(main())
[  741.876891] env[72332]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  741.876891] env[72332]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  741.876891] env[72332]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  741.876891] env[72332]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  741.876891] env[72332]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  741.876891] env[72332]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  741.876891] env[72332]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  741.876891] env[72332]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  741.876891] env[72332]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  741.876891] env[72332]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  741.876891] env[72332]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  741.876891] env[72332]: ERROR neutron     response = self.get(path=path, params=params)
[  741.877644] env[72332]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  741.877644] env[72332]: ERROR neutron     raise RuntimeError(msg, last_err)
[  741.877644] env[72332]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  741.877644] env[72332]: ERROR neutron 
[  744.531643] env[72559]: INFO neutron.common.config [-] Logging enabled!
[  744.531998] env[72559]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  744.532226] env[72559]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=72559) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  744.532440] env[72559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  744.532531] env[72559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  744.533358] env[72559]: WARNING oslo_policy.policy [None req-fba184dd-36a5-4f19-8dec-ac5dbe27755a None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  744.533572] env[72559]: WARNING oslo_policy.policy [None req-fba184dd-36a5-4f19-8dec-ac5dbe27755a None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  744.534774] env[72559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-fba184dd-36a5-4f19-8dec-ac5dbe27755a None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  744.549310] env[72559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-fba184dd-36a5-4f19-8dec-ac5dbe27755a None None] Session token - acquiring
[  744.550168] env[72559]: DEBUG networking_nsxv3.common.locking [None req-fba184dd-36a5-4f19-8dec-ac5dbe27755a None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=72559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  744.550356] env[72559]: DEBUG oslo_concurrency.lockutils [None req-fba184dd-36a5-4f19-8dec-ac5dbe27755a None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  744.550480] env[72559]: DEBUG oslo_concurrency.lockutils [None req-fba184dd-36a5-4f19-8dec-ac5dbe27755a None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  744.550878] env[72559]: DEBUG oslo_concurrency.lockutils [None req-fba184dd-36a5-4f19-8dec-ac5dbe27755a None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  744.560394] env[72559]: DEBUG oslo_concurrency.lockutils [None req-fba184dd-36a5-4f19-8dec-ac5dbe27755a None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  744.560616] env[72559]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-fba184dd-36a5-4f19-8dec-ac5dbe27755a None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  744.560761] env[72559]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-fba184dd-36a5-4f19-8dec-ac5dbe27755a None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=72559) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  746.566882] env[72559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-fba184dd-36a5-4f19-8dec-ac5dbe27755a None None] Session token - acquiring
[  746.567195] env[72559]: DEBUG networking_nsxv3.common.locking [None req-fba184dd-36a5-4f19-8dec-ac5dbe27755a None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=72559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  746.567363] env[72559]: DEBUG oslo_concurrency.lockutils [None req-fba184dd-36a5-4f19-8dec-ac5dbe27755a None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  746.567483] env[72559]: DEBUG oslo_concurrency.lockutils [None req-fba184dd-36a5-4f19-8dec-ac5dbe27755a None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  746.567765] env[72559]: DEBUG oslo_concurrency.lockutils [None req-fba184dd-36a5-4f19-8dec-ac5dbe27755a None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  746.577342] env[72559]: DEBUG oslo_concurrency.lockutils [None req-fba184dd-36a5-4f19-8dec-ac5dbe27755a None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  746.577608] env[72559]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-fba184dd-36a5-4f19-8dec-ac5dbe27755a None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  746.578481] env[72559]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-fba184dd-36a5-4f19-8dec-ac5dbe27755a None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=72559) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  748.580711] env[72559]: CRITICAL neutron [None req-fba184dd-36a5-4f19-8dec-ac5dbe27755a None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  748.580711] env[72559]: ERROR neutron Traceback (most recent call last):
[  748.580711] env[72559]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  748.580711] env[72559]: ERROR neutron     sys.exit(main())
[  748.580711] env[72559]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  748.580711] env[72559]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  748.580711] env[72559]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  748.580711] env[72559]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  748.580711] env[72559]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  748.580711] env[72559]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  748.580711] env[72559]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  748.580711] env[72559]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  748.580711] env[72559]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  748.580711] env[72559]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  748.580711] env[72559]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  748.580711] env[72559]: ERROR neutron     response = self.get(path=path, params=params)
[  748.582062] env[72559]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  748.582062] env[72559]: ERROR neutron     raise RuntimeError(msg, last_err)
[  748.582062] env[72559]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  748.582062] env[72559]: ERROR neutron 
[  751.485459] env[72731]: INFO neutron.common.config [-] Logging enabled!
[  751.485667] env[72731]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  751.485921] env[72731]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=72731) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  751.486763] env[72731]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  751.486763] env[72731]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  751.487068] env[72731]: WARNING oslo_policy.policy [None req-67f5a4a2-9283-49ed-9db1-59bc86076844 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  751.487283] env[72731]: WARNING oslo_policy.policy [None req-67f5a4a2-9283-49ed-9db1-59bc86076844 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  751.488559] env[72731]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-67f5a4a2-9283-49ed-9db1-59bc86076844 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  751.503056] env[72731]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-67f5a4a2-9283-49ed-9db1-59bc86076844 None None] Session token - acquiring
[  751.503897] env[72731]: DEBUG networking_nsxv3.common.locking [None req-67f5a4a2-9283-49ed-9db1-59bc86076844 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=72731) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  751.504551] env[72731]: DEBUG oslo_concurrency.lockutils [None req-67f5a4a2-9283-49ed-9db1-59bc86076844 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72731) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  751.504551] env[72731]: DEBUG oslo_concurrency.lockutils [None req-67f5a4a2-9283-49ed-9db1-59bc86076844 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72731) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  751.504856] env[72731]: DEBUG oslo_concurrency.lockutils [None req-67f5a4a2-9283-49ed-9db1-59bc86076844 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72731) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  751.514519] env[72731]: DEBUG oslo_concurrency.lockutils [None req-67f5a4a2-9283-49ed-9db1-59bc86076844 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72731) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  751.514776] env[72731]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-67f5a4a2-9283-49ed-9db1-59bc86076844 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  751.514925] env[72731]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-67f5a4a2-9283-49ed-9db1-59bc86076844 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=72731) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  753.521555] env[72731]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-67f5a4a2-9283-49ed-9db1-59bc86076844 None None] Session token - acquiring
[  753.521555] env[72731]: DEBUG networking_nsxv3.common.locking [None req-67f5a4a2-9283-49ed-9db1-59bc86076844 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=72731) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  753.521555] env[72731]: DEBUG oslo_concurrency.lockutils [None req-67f5a4a2-9283-49ed-9db1-59bc86076844 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72731) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  753.521853] env[72731]: DEBUG oslo_concurrency.lockutils [None req-67f5a4a2-9283-49ed-9db1-59bc86076844 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72731) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  753.521853] env[72731]: DEBUG oslo_concurrency.lockutils [None req-67f5a4a2-9283-49ed-9db1-59bc86076844 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72731) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  753.531746] env[72731]: DEBUG oslo_concurrency.lockutils [None req-67f5a4a2-9283-49ed-9db1-59bc86076844 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=72731) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  753.532081] env[72731]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-67f5a4a2-9283-49ed-9db1-59bc86076844 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  753.532842] env[72731]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-67f5a4a2-9283-49ed-9db1-59bc86076844 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=72731) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  755.535747] env[72731]: CRITICAL neutron [None req-67f5a4a2-9283-49ed-9db1-59bc86076844 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  755.535747] env[72731]: ERROR neutron Traceback (most recent call last):
[  755.535747] env[72731]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  755.535747] env[72731]: ERROR neutron     sys.exit(main())
[  755.535747] env[72731]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  755.535747] env[72731]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  755.535747] env[72731]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  755.535747] env[72731]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  755.535747] env[72731]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  755.535747] env[72731]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  755.535747] env[72731]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  755.535747] env[72731]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  755.535747] env[72731]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  755.535747] env[72731]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  755.535747] env[72731]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  755.535747] env[72731]: ERROR neutron     response = self.get(path=path, params=params)
[  755.536434] env[72731]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  755.536434] env[72731]: ERROR neutron     raise RuntimeError(msg, last_err)
[  755.536434] env[72731]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  755.536434] env[72731]: ERROR neutron 
[  758.379688] env[73023]: INFO neutron.common.config [-] Logging enabled!
[  758.379688] env[73023]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  758.380277] env[73023]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=73023) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  758.380277] env[73023]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  758.380277] env[73023]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  758.380928] env[73023]: WARNING oslo_policy.policy [None req-7a8f6e7c-4ba4-4aea-905a-6cb5d79836f7 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  758.381145] env[73023]: WARNING oslo_policy.policy [None req-7a8f6e7c-4ba4-4aea-905a-6cb5d79836f7 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  758.382360] env[73023]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-7a8f6e7c-4ba4-4aea-905a-6cb5d79836f7 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  758.397388] env[73023]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-7a8f6e7c-4ba4-4aea-905a-6cb5d79836f7 None None] Session token - acquiring
[  758.398333] env[73023]: DEBUG networking_nsxv3.common.locking [None req-7a8f6e7c-4ba4-4aea-905a-6cb5d79836f7 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=73023) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  758.398551] env[73023]: DEBUG oslo_concurrency.lockutils [None req-7a8f6e7c-4ba4-4aea-905a-6cb5d79836f7 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73023) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  758.398677] env[73023]: DEBUG oslo_concurrency.lockutils [None req-7a8f6e7c-4ba4-4aea-905a-6cb5d79836f7 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73023) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  758.399050] env[73023]: DEBUG oslo_concurrency.lockutils [None req-7a8f6e7c-4ba4-4aea-905a-6cb5d79836f7 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73023) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  758.413717] env[73023]: DEBUG oslo_concurrency.lockutils [None req-7a8f6e7c-4ba4-4aea-905a-6cb5d79836f7 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73023) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  758.414065] env[73023]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-7a8f6e7c-4ba4-4aea-905a-6cb5d79836f7 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  758.414340] env[73023]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-7a8f6e7c-4ba4-4aea-905a-6cb5d79836f7 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=73023) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  760.420451] env[73023]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-7a8f6e7c-4ba4-4aea-905a-6cb5d79836f7 None None] Session token - acquiring
[  760.420787] env[73023]: DEBUG networking_nsxv3.common.locking [None req-7a8f6e7c-4ba4-4aea-905a-6cb5d79836f7 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=73023) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  760.420986] env[73023]: DEBUG oslo_concurrency.lockutils [None req-7a8f6e7c-4ba4-4aea-905a-6cb5d79836f7 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73023) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  760.421155] env[73023]: DEBUG oslo_concurrency.lockutils [None req-7a8f6e7c-4ba4-4aea-905a-6cb5d79836f7 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73023) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  760.421348] env[73023]: DEBUG oslo_concurrency.lockutils [None req-7a8f6e7c-4ba4-4aea-905a-6cb5d79836f7 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73023) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  760.430160] env[73023]: DEBUG oslo_concurrency.lockutils [None req-7a8f6e7c-4ba4-4aea-905a-6cb5d79836f7 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73023) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  760.430395] env[73023]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-7a8f6e7c-4ba4-4aea-905a-6cb5d79836f7 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  760.430660] env[73023]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-7a8f6e7c-4ba4-4aea-905a-6cb5d79836f7 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=73023) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  762.432891] env[73023]: CRITICAL neutron [None req-7a8f6e7c-4ba4-4aea-905a-6cb5d79836f7 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  762.432891] env[73023]: ERROR neutron Traceback (most recent call last):
[  762.432891] env[73023]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  762.432891] env[73023]: ERROR neutron     sys.exit(main())
[  762.432891] env[73023]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  762.432891] env[73023]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  762.432891] env[73023]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  762.432891] env[73023]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  762.432891] env[73023]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  762.432891] env[73023]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  762.432891] env[73023]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  762.432891] env[73023]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  762.432891] env[73023]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  762.432891] env[73023]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  762.432891] env[73023]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  762.432891] env[73023]: ERROR neutron     response = self.get(path=path, params=params)
[  762.433640] env[73023]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  762.433640] env[73023]: ERROR neutron     raise RuntimeError(msg, last_err)
[  762.433640] env[73023]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  762.433640] env[73023]: ERROR neutron 
[  765.047617] env[73136]: INFO neutron.common.config [-] Logging enabled!
[  765.047870] env[73136]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  765.048216] env[73136]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=73136) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  765.048450] env[73136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  765.048539] env[73136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  765.049380] env[73136]: WARNING oslo_policy.policy [None req-b4557aed-deba-4d52-b798-cab2acdd4488 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  765.049596] env[73136]: WARNING oslo_policy.policy [None req-b4557aed-deba-4d52-b798-cab2acdd4488 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  765.050866] env[73136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-b4557aed-deba-4d52-b798-cab2acdd4488 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  765.065181] env[73136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-b4557aed-deba-4d52-b798-cab2acdd4488 None None] Session token - acquiring
[  765.065997] env[73136]: DEBUG networking_nsxv3.common.locking [None req-b4557aed-deba-4d52-b798-cab2acdd4488 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=73136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  765.066206] env[73136]: DEBUG oslo_concurrency.lockutils [None req-b4557aed-deba-4d52-b798-cab2acdd4488 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  765.066334] env[73136]: DEBUG oslo_concurrency.lockutils [None req-b4557aed-deba-4d52-b798-cab2acdd4488 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  765.066711] env[73136]: DEBUG oslo_concurrency.lockutils [None req-b4557aed-deba-4d52-b798-cab2acdd4488 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  765.076305] env[73136]: DEBUG oslo_concurrency.lockutils [None req-b4557aed-deba-4d52-b798-cab2acdd4488 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  765.076615] env[73136]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-b4557aed-deba-4d52-b798-cab2acdd4488 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  765.076796] env[73136]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-b4557aed-deba-4d52-b798-cab2acdd4488 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=73136) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  767.082718] env[73136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-b4557aed-deba-4d52-b798-cab2acdd4488 None None] Session token - acquiring
[  767.083015] env[73136]: DEBUG networking_nsxv3.common.locking [None req-b4557aed-deba-4d52-b798-cab2acdd4488 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=73136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  767.083205] env[73136]: DEBUG oslo_concurrency.lockutils [None req-b4557aed-deba-4d52-b798-cab2acdd4488 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  767.083337] env[73136]: DEBUG oslo_concurrency.lockutils [None req-b4557aed-deba-4d52-b798-cab2acdd4488 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  767.083609] env[73136]: DEBUG oslo_concurrency.lockutils [None req-b4557aed-deba-4d52-b798-cab2acdd4488 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  767.092676] env[73136]: DEBUG oslo_concurrency.lockutils [None req-b4557aed-deba-4d52-b798-cab2acdd4488 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  767.092922] env[73136]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-b4557aed-deba-4d52-b798-cab2acdd4488 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  767.093064] env[73136]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-b4557aed-deba-4d52-b798-cab2acdd4488 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=73136) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  769.096030] env[73136]: CRITICAL neutron [None req-b4557aed-deba-4d52-b798-cab2acdd4488 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  769.096030] env[73136]: ERROR neutron Traceback (most recent call last):
[  769.096030] env[73136]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  769.096030] env[73136]: ERROR neutron     sys.exit(main())
[  769.096030] env[73136]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  769.096030] env[73136]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  769.096030] env[73136]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  769.096030] env[73136]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  769.096030] env[73136]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  769.096030] env[73136]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  769.096030] env[73136]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  769.096030] env[73136]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  769.096030] env[73136]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  769.096030] env[73136]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  769.096030] env[73136]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  769.096030] env[73136]: ERROR neutron     response = self.get(path=path, params=params)
[  769.096772] env[73136]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  769.096772] env[73136]: ERROR neutron     raise RuntimeError(msg, last_err)
[  769.096772] env[73136]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  769.096772] env[73136]: ERROR neutron 
[  771.738127] env[73257]: INFO neutron.common.config [-] Logging enabled!
[  771.738127] env[73257]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  771.738127] env[73257]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=73257) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  771.738127] env[73257]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  771.738127] env[73257]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  771.738127] env[73257]: WARNING oslo_policy.policy [None req-5f786521-e451-46e8-8ecc-aab19c424f63 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  771.738127] env[73257]: WARNING oslo_policy.policy [None req-5f786521-e451-46e8-8ecc-aab19c424f63 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  771.738662] env[73257]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-5f786521-e451-46e8-8ecc-aab19c424f63 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  771.760768] env[73257]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5f786521-e451-46e8-8ecc-aab19c424f63 None None] Session token - acquiring
[  771.761572] env[73257]: DEBUG networking_nsxv3.common.locking [None req-5f786521-e451-46e8-8ecc-aab19c424f63 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=73257) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  771.761776] env[73257]: DEBUG oslo_concurrency.lockutils [None req-5f786521-e451-46e8-8ecc-aab19c424f63 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  771.761904] env[73257]: DEBUG oslo_concurrency.lockutils [None req-5f786521-e451-46e8-8ecc-aab19c424f63 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  771.762306] env[73257]: DEBUG oslo_concurrency.lockutils [None req-5f786521-e451-46e8-8ecc-aab19c424f63 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  771.771175] env[73257]: DEBUG oslo_concurrency.lockutils [None req-5f786521-e451-46e8-8ecc-aab19c424f63 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  771.771422] env[73257]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5f786521-e451-46e8-8ecc-aab19c424f63 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  771.771577] env[73257]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5f786521-e451-46e8-8ecc-aab19c424f63 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=73257) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  773.777683] env[73257]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5f786521-e451-46e8-8ecc-aab19c424f63 None None] Session token - acquiring
[  773.778088] env[73257]: DEBUG networking_nsxv3.common.locking [None req-5f786521-e451-46e8-8ecc-aab19c424f63 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=73257) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  773.778286] env[73257]: DEBUG oslo_concurrency.lockutils [None req-5f786521-e451-46e8-8ecc-aab19c424f63 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  773.778412] env[73257]: DEBUG oslo_concurrency.lockutils [None req-5f786521-e451-46e8-8ecc-aab19c424f63 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  773.778680] env[73257]: DEBUG oslo_concurrency.lockutils [None req-5f786521-e451-46e8-8ecc-aab19c424f63 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  773.788909] env[73257]: DEBUG oslo_concurrency.lockutils [None req-5f786521-e451-46e8-8ecc-aab19c424f63 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  773.789173] env[73257]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5f786521-e451-46e8-8ecc-aab19c424f63 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  773.789317] env[73257]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5f786521-e451-46e8-8ecc-aab19c424f63 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=73257) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  775.790524] env[73257]: CRITICAL neutron [None req-5f786521-e451-46e8-8ecc-aab19c424f63 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  775.790524] env[73257]: ERROR neutron Traceback (most recent call last):
[  775.790524] env[73257]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  775.790524] env[73257]: ERROR neutron     sys.exit(main())
[  775.790524] env[73257]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  775.790524] env[73257]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  775.790524] env[73257]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  775.790524] env[73257]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  775.790524] env[73257]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  775.790524] env[73257]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  775.790524] env[73257]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  775.790524] env[73257]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  775.790524] env[73257]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  775.790524] env[73257]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  775.790524] env[73257]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  775.790524] env[73257]: ERROR neutron     response = self.get(path=path, params=params)
[  775.791186] env[73257]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  775.791186] env[73257]: ERROR neutron     raise RuntimeError(msg, last_err)
[  775.791186] env[73257]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  775.791186] env[73257]: ERROR neutron 
[  778.467799] env[73374]: INFO neutron.common.config [-] Logging enabled!
[  778.468167] env[73374]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  778.468420] env[73374]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=73374) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  778.468672] env[73374]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  778.468768] env[73374]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  778.469621] env[73374]: WARNING oslo_policy.policy [None req-3ae37a0d-5614-4e87-9000-6984ee0d313e None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  778.469843] env[73374]: WARNING oslo_policy.policy [None req-3ae37a0d-5614-4e87-9000-6984ee0d313e None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  778.471108] env[73374]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-3ae37a0d-5614-4e87-9000-6984ee0d313e None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  778.485248] env[73374]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3ae37a0d-5614-4e87-9000-6984ee0d313e None None] Session token - acquiring
[  778.486028] env[73374]: DEBUG networking_nsxv3.common.locking [None req-3ae37a0d-5614-4e87-9000-6984ee0d313e None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=73374) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  778.486237] env[73374]: DEBUG oslo_concurrency.lockutils [None req-3ae37a0d-5614-4e87-9000-6984ee0d313e None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73374) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  778.486363] env[73374]: DEBUG oslo_concurrency.lockutils [None req-3ae37a0d-5614-4e87-9000-6984ee0d313e None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73374) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  778.486726] env[73374]: DEBUG oslo_concurrency.lockutils [None req-3ae37a0d-5614-4e87-9000-6984ee0d313e None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73374) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  778.495891] env[73374]: DEBUG oslo_concurrency.lockutils [None req-3ae37a0d-5614-4e87-9000-6984ee0d313e None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73374) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  778.496177] env[73374]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3ae37a0d-5614-4e87-9000-6984ee0d313e None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  778.496329] env[73374]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3ae37a0d-5614-4e87-9000-6984ee0d313e None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=73374) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  780.502328] env[73374]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3ae37a0d-5614-4e87-9000-6984ee0d313e None None] Session token - acquiring
[  780.502612] env[73374]: DEBUG networking_nsxv3.common.locking [None req-3ae37a0d-5614-4e87-9000-6984ee0d313e None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=73374) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  780.502811] env[73374]: DEBUG oslo_concurrency.lockutils [None req-3ae37a0d-5614-4e87-9000-6984ee0d313e None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73374) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  780.502927] env[73374]: DEBUG oslo_concurrency.lockutils [None req-3ae37a0d-5614-4e87-9000-6984ee0d313e None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73374) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  780.503206] env[73374]: DEBUG oslo_concurrency.lockutils [None req-3ae37a0d-5614-4e87-9000-6984ee0d313e None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73374) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  780.513029] env[73374]: DEBUG oslo_concurrency.lockutils [None req-3ae37a0d-5614-4e87-9000-6984ee0d313e None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73374) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  780.513029] env[73374]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3ae37a0d-5614-4e87-9000-6984ee0d313e None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  780.513029] env[73374]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3ae37a0d-5614-4e87-9000-6984ee0d313e None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=73374) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  782.515960] env[73374]: CRITICAL neutron [None req-3ae37a0d-5614-4e87-9000-6984ee0d313e None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  782.515960] env[73374]: ERROR neutron Traceback (most recent call last):
[  782.515960] env[73374]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  782.515960] env[73374]: ERROR neutron     sys.exit(main())
[  782.515960] env[73374]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  782.515960] env[73374]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  782.515960] env[73374]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  782.515960] env[73374]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  782.515960] env[73374]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  782.515960] env[73374]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  782.515960] env[73374]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  782.515960] env[73374]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  782.515960] env[73374]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  782.515960] env[73374]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  782.515960] env[73374]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  782.515960] env[73374]: ERROR neutron     response = self.get(path=path, params=params)
[  782.516577] env[73374]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  782.516577] env[73374]: ERROR neutron     raise RuntimeError(msg, last_err)
[  782.516577] env[73374]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  782.516577] env[73374]: ERROR neutron 
[  785.332023] env[73492]: INFO neutron.common.config [-] Logging enabled!
[  785.332367] env[73492]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  785.332587] env[73492]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=73492) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  785.332813] env[73492]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  785.332904] env[73492]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  785.333813] env[73492]: WARNING oslo_policy.policy [None req-e96c45a1-509c-4166-8d7a-39abff5277cb None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  785.334031] env[73492]: WARNING oslo_policy.policy [None req-e96c45a1-509c-4166-8d7a-39abff5277cb None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  785.335257] env[73492]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-e96c45a1-509c-4166-8d7a-39abff5277cb None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  785.358567] env[73492]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e96c45a1-509c-4166-8d7a-39abff5277cb None None] Session token - acquiring
[  785.359400] env[73492]: DEBUG networking_nsxv3.common.locking [None req-e96c45a1-509c-4166-8d7a-39abff5277cb None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=73492) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  785.359629] env[73492]: DEBUG oslo_concurrency.lockutils [None req-e96c45a1-509c-4166-8d7a-39abff5277cb None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73492) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  785.359760] env[73492]: DEBUG oslo_concurrency.lockutils [None req-e96c45a1-509c-4166-8d7a-39abff5277cb None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73492) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  785.360172] env[73492]: DEBUG oslo_concurrency.lockutils [None req-e96c45a1-509c-4166-8d7a-39abff5277cb None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73492) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  785.369203] env[73492]: DEBUG oslo_concurrency.lockutils [None req-e96c45a1-509c-4166-8d7a-39abff5277cb None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73492) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  785.369456] env[73492]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e96c45a1-509c-4166-8d7a-39abff5277cb None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  785.369605] env[73492]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e96c45a1-509c-4166-8d7a-39abff5277cb None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=73492) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  787.377996] env[73492]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e96c45a1-509c-4166-8d7a-39abff5277cb None None] Session token - acquiring
[  787.378488] env[73492]: DEBUG networking_nsxv3.common.locking [None req-e96c45a1-509c-4166-8d7a-39abff5277cb None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=73492) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  787.378686] env[73492]: DEBUG oslo_concurrency.lockutils [None req-e96c45a1-509c-4166-8d7a-39abff5277cb None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73492) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  787.378812] env[73492]: DEBUG oslo_concurrency.lockutils [None req-e96c45a1-509c-4166-8d7a-39abff5277cb None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73492) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  787.379115] env[73492]: DEBUG oslo_concurrency.lockutils [None req-e96c45a1-509c-4166-8d7a-39abff5277cb None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73492) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  787.388208] env[73492]: DEBUG oslo_concurrency.lockutils [None req-e96c45a1-509c-4166-8d7a-39abff5277cb None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73492) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  787.388448] env[73492]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e96c45a1-509c-4166-8d7a-39abff5277cb None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  787.388584] env[73492]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e96c45a1-509c-4166-8d7a-39abff5277cb None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=73492) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  789.391746] env[73492]: CRITICAL neutron [None req-e96c45a1-509c-4166-8d7a-39abff5277cb None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  789.391746] env[73492]: ERROR neutron Traceback (most recent call last):
[  789.391746] env[73492]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  789.391746] env[73492]: ERROR neutron     sys.exit(main())
[  789.391746] env[73492]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  789.391746] env[73492]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  789.391746] env[73492]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  789.391746] env[73492]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  789.391746] env[73492]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  789.391746] env[73492]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  789.391746] env[73492]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  789.391746] env[73492]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  789.391746] env[73492]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  789.391746] env[73492]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  789.391746] env[73492]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  789.391746] env[73492]: ERROR neutron     response = self.get(path=path, params=params)
[  789.392449] env[73492]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  789.392449] env[73492]: ERROR neutron     raise RuntimeError(msg, last_err)
[  789.392449] env[73492]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  789.392449] env[73492]: ERROR neutron 
[  792.154851] env[73639]: INFO neutron.common.config [-] Logging enabled!
[  792.155176] env[73639]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  792.155388] env[73639]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=73639) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  792.155627] env[73639]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  792.155725] env[73639]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  792.156622] env[73639]: WARNING oslo_policy.policy [None req-cf38c7bb-1730-4f45-beeb-e1746d410690 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  792.156875] env[73639]: WARNING oslo_policy.policy [None req-cf38c7bb-1730-4f45-beeb-e1746d410690 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  792.158160] env[73639]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-cf38c7bb-1730-4f45-beeb-e1746d410690 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  792.178275] env[73639]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-cf38c7bb-1730-4f45-beeb-e1746d410690 None None] Session token - acquiring
[  792.179719] env[73639]: DEBUG networking_nsxv3.common.locking [None req-cf38c7bb-1730-4f45-beeb-e1746d410690 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=73639) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  792.179979] env[73639]: DEBUG oslo_concurrency.lockutils [None req-cf38c7bb-1730-4f45-beeb-e1746d410690 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73639) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  792.180109] env[73639]: DEBUG oslo_concurrency.lockutils [None req-cf38c7bb-1730-4f45-beeb-e1746d410690 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73639) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  792.180496] env[73639]: DEBUG oslo_concurrency.lockutils [None req-cf38c7bb-1730-4f45-beeb-e1746d410690 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73639) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  792.190314] env[73639]: DEBUG oslo_concurrency.lockutils [None req-cf38c7bb-1730-4f45-beeb-e1746d410690 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73639) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  792.190576] env[73639]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-cf38c7bb-1730-4f45-beeb-e1746d410690 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  792.190724] env[73639]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-cf38c7bb-1730-4f45-beeb-e1746d410690 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=73639) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  794.197081] env[73639]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-cf38c7bb-1730-4f45-beeb-e1746d410690 None None] Session token - acquiring
[  794.197475] env[73639]: DEBUG networking_nsxv3.common.locking [None req-cf38c7bb-1730-4f45-beeb-e1746d410690 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=73639) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  794.197680] env[73639]: DEBUG oslo_concurrency.lockutils [None req-cf38c7bb-1730-4f45-beeb-e1746d410690 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73639) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  794.197824] env[73639]: DEBUG oslo_concurrency.lockutils [None req-cf38c7bb-1730-4f45-beeb-e1746d410690 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73639) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  794.198106] env[73639]: DEBUG oslo_concurrency.lockutils [None req-cf38c7bb-1730-4f45-beeb-e1746d410690 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73639) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  794.207445] env[73639]: DEBUG oslo_concurrency.lockutils [None req-cf38c7bb-1730-4f45-beeb-e1746d410690 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73639) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  794.208220] env[73639]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-cf38c7bb-1730-4f45-beeb-e1746d410690 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  794.208416] env[73639]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-cf38c7bb-1730-4f45-beeb-e1746d410690 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=73639) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  796.211378] env[73639]: CRITICAL neutron [None req-cf38c7bb-1730-4f45-beeb-e1746d410690 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  796.211378] env[73639]: ERROR neutron Traceback (most recent call last):
[  796.211378] env[73639]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  796.211378] env[73639]: ERROR neutron     sys.exit(main())
[  796.211378] env[73639]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  796.211378] env[73639]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  796.211378] env[73639]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  796.211378] env[73639]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  796.211378] env[73639]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  796.211378] env[73639]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  796.211378] env[73639]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  796.211378] env[73639]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  796.211378] env[73639]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  796.211378] env[73639]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  796.211378] env[73639]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  796.211378] env[73639]: ERROR neutron     response = self.get(path=path, params=params)
[  796.212110] env[73639]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  796.212110] env[73639]: ERROR neutron     raise RuntimeError(msg, last_err)
[  796.212110] env[73639]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  796.212110] env[73639]: ERROR neutron 
[  798.785644] env[73778]: INFO neutron.common.config [-] Logging enabled!
[  798.785644] env[73778]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  798.786001] env[73778]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=73778) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  798.786103] env[73778]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  798.786193] env[73778]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  798.787040] env[73778]: WARNING oslo_policy.policy [None req-d44e2d4c-a529-4c72-af0f-9434f05012f9 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  798.787224] env[73778]: WARNING oslo_policy.policy [None req-d44e2d4c-a529-4c72-af0f-9434f05012f9 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  798.788541] env[73778]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-d44e2d4c-a529-4c72-af0f-9434f05012f9 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  798.802366] env[73778]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-d44e2d4c-a529-4c72-af0f-9434f05012f9 None None] Session token - acquiring
[  798.803178] env[73778]: DEBUG networking_nsxv3.common.locking [None req-d44e2d4c-a529-4c72-af0f-9434f05012f9 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=73778) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  798.803384] env[73778]: DEBUG oslo_concurrency.lockutils [None req-d44e2d4c-a529-4c72-af0f-9434f05012f9 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73778) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  798.803509] env[73778]: DEBUG oslo_concurrency.lockutils [None req-d44e2d4c-a529-4c72-af0f-9434f05012f9 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73778) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  798.803868] env[73778]: DEBUG oslo_concurrency.lockutils [None req-d44e2d4c-a529-4c72-af0f-9434f05012f9 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73778) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  798.812889] env[73778]: DEBUG oslo_concurrency.lockutils [None req-d44e2d4c-a529-4c72-af0f-9434f05012f9 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73778) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  798.813144] env[73778]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-d44e2d4c-a529-4c72-af0f-9434f05012f9 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  798.813291] env[73778]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-d44e2d4c-a529-4c72-af0f-9434f05012f9 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=73778) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  800.821357] env[73778]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-d44e2d4c-a529-4c72-af0f-9434f05012f9 None None] Session token - acquiring
[  800.821707] env[73778]: DEBUG networking_nsxv3.common.locking [None req-d44e2d4c-a529-4c72-af0f-9434f05012f9 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=73778) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  800.821865] env[73778]: DEBUG oslo_concurrency.lockutils [None req-d44e2d4c-a529-4c72-af0f-9434f05012f9 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73778) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  800.821963] env[73778]: DEBUG oslo_concurrency.lockutils [None req-d44e2d4c-a529-4c72-af0f-9434f05012f9 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73778) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  800.822244] env[73778]: DEBUG oslo_concurrency.lockutils [None req-d44e2d4c-a529-4c72-af0f-9434f05012f9 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73778) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  800.831347] env[73778]: DEBUG oslo_concurrency.lockutils [None req-d44e2d4c-a529-4c72-af0f-9434f05012f9 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73778) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  800.831596] env[73778]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-d44e2d4c-a529-4c72-af0f-9434f05012f9 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  800.831748] env[73778]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-d44e2d4c-a529-4c72-af0f-9434f05012f9 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=73778) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  802.833073] env[73778]: CRITICAL neutron [None req-d44e2d4c-a529-4c72-af0f-9434f05012f9 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  802.833073] env[73778]: ERROR neutron Traceback (most recent call last):
[  802.833073] env[73778]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  802.833073] env[73778]: ERROR neutron     sys.exit(main())
[  802.833073] env[73778]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  802.833073] env[73778]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  802.833073] env[73778]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  802.833073] env[73778]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  802.833073] env[73778]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  802.833073] env[73778]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  802.833073] env[73778]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  802.833073] env[73778]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  802.833073] env[73778]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  802.833073] env[73778]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  802.833073] env[73778]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  802.833073] env[73778]: ERROR neutron     response = self.get(path=path, params=params)
[  802.833810] env[73778]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  802.833810] env[73778]: ERROR neutron     raise RuntimeError(msg, last_err)
[  802.833810] env[73778]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  802.833810] env[73778]: ERROR neutron 
[  805.626796] env[73901]: INFO neutron.common.config [-] Logging enabled!
[  805.627078] env[73901]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  805.627378] env[73901]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=73901) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  805.627628] env[73901]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  805.627725] env[73901]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  805.628562] env[73901]: WARNING oslo_policy.policy [None req-b4df32af-e41b-4cab-b23e-61452b6916ac None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  805.629112] env[73901]: WARNING oslo_policy.policy [None req-b4df32af-e41b-4cab-b23e-61452b6916ac None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  805.630004] env[73901]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-b4df32af-e41b-4cab-b23e-61452b6916ac None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  805.643510] env[73901]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-b4df32af-e41b-4cab-b23e-61452b6916ac None None] Session token - acquiring
[  805.644312] env[73901]: DEBUG networking_nsxv3.common.locking [None req-b4df32af-e41b-4cab-b23e-61452b6916ac None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=73901) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  805.644508] env[73901]: DEBUG oslo_concurrency.lockutils [None req-b4df32af-e41b-4cab-b23e-61452b6916ac None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73901) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  805.644634] env[73901]: DEBUG oslo_concurrency.lockutils [None req-b4df32af-e41b-4cab-b23e-61452b6916ac None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73901) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  805.644997] env[73901]: DEBUG oslo_concurrency.lockutils [None req-b4df32af-e41b-4cab-b23e-61452b6916ac None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73901) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  805.654569] env[73901]: DEBUG oslo_concurrency.lockutils [None req-b4df32af-e41b-4cab-b23e-61452b6916ac None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73901) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  805.654812] env[73901]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-b4df32af-e41b-4cab-b23e-61452b6916ac None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  805.654968] env[73901]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-b4df32af-e41b-4cab-b23e-61452b6916ac None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=73901) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  807.660917] env[73901]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-b4df32af-e41b-4cab-b23e-61452b6916ac None None] Session token - acquiring
[  807.661260] env[73901]: DEBUG networking_nsxv3.common.locking [None req-b4df32af-e41b-4cab-b23e-61452b6916ac None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=73901) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  807.661452] env[73901]: DEBUG oslo_concurrency.lockutils [None req-b4df32af-e41b-4cab-b23e-61452b6916ac None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73901) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  807.661572] env[73901]: DEBUG oslo_concurrency.lockutils [None req-b4df32af-e41b-4cab-b23e-61452b6916ac None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73901) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  807.661851] env[73901]: DEBUG oslo_concurrency.lockutils [None req-b4df32af-e41b-4cab-b23e-61452b6916ac None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73901) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  807.670933] env[73901]: DEBUG oslo_concurrency.lockutils [None req-b4df32af-e41b-4cab-b23e-61452b6916ac None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=73901) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  807.671208] env[73901]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-b4df32af-e41b-4cab-b23e-61452b6916ac None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  807.671346] env[73901]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-b4df32af-e41b-4cab-b23e-61452b6916ac None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=73901) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  809.674339] env[73901]: CRITICAL neutron [None req-b4df32af-e41b-4cab-b23e-61452b6916ac None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  809.674339] env[73901]: ERROR neutron Traceback (most recent call last):
[  809.674339] env[73901]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  809.674339] env[73901]: ERROR neutron     sys.exit(main())
[  809.674339] env[73901]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  809.674339] env[73901]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  809.674339] env[73901]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  809.674339] env[73901]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  809.674339] env[73901]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  809.674339] env[73901]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  809.674339] env[73901]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  809.674339] env[73901]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  809.674339] env[73901]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  809.674339] env[73901]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  809.674339] env[73901]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  809.674339] env[73901]: ERROR neutron     response = self.get(path=path, params=params)
[  809.675113] env[73901]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  809.675113] env[73901]: ERROR neutron     raise RuntimeError(msg, last_err)
[  809.675113] env[73901]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  809.675113] env[73901]: ERROR neutron 
[  812.342820] env[74139]: INFO neutron.common.config [-] Logging enabled!
[  812.343037] env[74139]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  812.343358] env[74139]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=74139) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  812.343591] env[74139]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  812.343686] env[74139]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  812.344551] env[74139]: WARNING oslo_policy.policy [None req-a63f9e11-f924-464d-881e-a5c205353fd0 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  812.344964] env[74139]: WARNING oslo_policy.policy [None req-a63f9e11-f924-464d-881e-a5c205353fd0 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  812.346090] env[74139]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-a63f9e11-f924-464d-881e-a5c205353fd0 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  812.361269] env[74139]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-a63f9e11-f924-464d-881e-a5c205353fd0 None None] Session token - acquiring
[  812.362100] env[74139]: DEBUG networking_nsxv3.common.locking [None req-a63f9e11-f924-464d-881e-a5c205353fd0 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=74139) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  812.362314] env[74139]: DEBUG oslo_concurrency.lockutils [None req-a63f9e11-f924-464d-881e-a5c205353fd0 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74139) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  812.362459] env[74139]: DEBUG oslo_concurrency.lockutils [None req-a63f9e11-f924-464d-881e-a5c205353fd0 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74139) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  812.362834] env[74139]: DEBUG oslo_concurrency.lockutils [None req-a63f9e11-f924-464d-881e-a5c205353fd0 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74139) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  812.372245] env[74139]: DEBUG oslo_concurrency.lockutils [None req-a63f9e11-f924-464d-881e-a5c205353fd0 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74139) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  812.372523] env[74139]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-a63f9e11-f924-464d-881e-a5c205353fd0 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  812.372672] env[74139]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-a63f9e11-f924-464d-881e-a5c205353fd0 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=74139) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  814.378641] env[74139]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-a63f9e11-f924-464d-881e-a5c205353fd0 None None] Session token - acquiring
[  814.378990] env[74139]: DEBUG networking_nsxv3.common.locking [None req-a63f9e11-f924-464d-881e-a5c205353fd0 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=74139) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  814.379187] env[74139]: DEBUG oslo_concurrency.lockutils [None req-a63f9e11-f924-464d-881e-a5c205353fd0 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74139) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  814.379307] env[74139]: DEBUG oslo_concurrency.lockutils [None req-a63f9e11-f924-464d-881e-a5c205353fd0 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74139) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  814.379571] env[74139]: DEBUG oslo_concurrency.lockutils [None req-a63f9e11-f924-464d-881e-a5c205353fd0 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74139) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  814.388844] env[74139]: DEBUG oslo_concurrency.lockutils [None req-a63f9e11-f924-464d-881e-a5c205353fd0 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74139) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  814.389078] env[74139]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-a63f9e11-f924-464d-881e-a5c205353fd0 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  814.389215] env[74139]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-a63f9e11-f924-464d-881e-a5c205353fd0 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=74139) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  816.392147] env[74139]: CRITICAL neutron [None req-a63f9e11-f924-464d-881e-a5c205353fd0 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  816.392147] env[74139]: ERROR neutron Traceback (most recent call last):
[  816.392147] env[74139]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  816.392147] env[74139]: ERROR neutron     sys.exit(main())
[  816.392147] env[74139]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  816.392147] env[74139]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  816.392147] env[74139]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  816.392147] env[74139]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  816.392147] env[74139]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  816.392147] env[74139]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  816.392147] env[74139]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  816.392147] env[74139]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  816.392147] env[74139]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  816.392147] env[74139]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  816.392147] env[74139]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  816.392147] env[74139]: ERROR neutron     response = self.get(path=path, params=params)
[  816.392835] env[74139]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  816.392835] env[74139]: ERROR neutron     raise RuntimeError(msg, last_err)
[  816.392835] env[74139]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  816.392835] env[74139]: ERROR neutron 
[  819.140399] env[74262]: INFO neutron.common.config [-] Logging enabled!
[  819.140716] env[74262]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  819.140964] env[74262]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=74262) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  819.141209] env[74262]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  819.141306] env[74262]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  819.142151] env[74262]: WARNING oslo_policy.policy [None req-f69a8aea-37c6-4b84-8c3b-eb11ec7896b8 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  819.142375] env[74262]: WARNING oslo_policy.policy [None req-f69a8aea-37c6-4b84-8c3b-eb11ec7896b8 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  819.143584] env[74262]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-f69a8aea-37c6-4b84-8c3b-eb11ec7896b8 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  819.158451] env[74262]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f69a8aea-37c6-4b84-8c3b-eb11ec7896b8 None None] Session token - acquiring
[  819.159255] env[74262]: DEBUG networking_nsxv3.common.locking [None req-f69a8aea-37c6-4b84-8c3b-eb11ec7896b8 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=74262) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  819.159895] env[74262]: DEBUG oslo_concurrency.lockutils [None req-f69a8aea-37c6-4b84-8c3b-eb11ec7896b8 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74262) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  819.160070] env[74262]: DEBUG oslo_concurrency.lockutils [None req-f69a8aea-37c6-4b84-8c3b-eb11ec7896b8 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74262) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  819.160569] env[74262]: DEBUG oslo_concurrency.lockutils [None req-f69a8aea-37c6-4b84-8c3b-eb11ec7896b8 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74262) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  819.169621] env[74262]: DEBUG oslo_concurrency.lockutils [None req-f69a8aea-37c6-4b84-8c3b-eb11ec7896b8 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74262) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  819.169971] env[74262]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f69a8aea-37c6-4b84-8c3b-eb11ec7896b8 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  819.170073] env[74262]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f69a8aea-37c6-4b84-8c3b-eb11ec7896b8 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=74262) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  821.176330] env[74262]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f69a8aea-37c6-4b84-8c3b-eb11ec7896b8 None None] Session token - acquiring
[  821.176715] env[74262]: DEBUG networking_nsxv3.common.locking [None req-f69a8aea-37c6-4b84-8c3b-eb11ec7896b8 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=74262) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  821.176870] env[74262]: DEBUG oslo_concurrency.lockutils [None req-f69a8aea-37c6-4b84-8c3b-eb11ec7896b8 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74262) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  821.177022] env[74262]: DEBUG oslo_concurrency.lockutils [None req-f69a8aea-37c6-4b84-8c3b-eb11ec7896b8 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74262) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  821.177315] env[74262]: DEBUG oslo_concurrency.lockutils [None req-f69a8aea-37c6-4b84-8c3b-eb11ec7896b8 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74262) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  821.186569] env[74262]: DEBUG oslo_concurrency.lockutils [None req-f69a8aea-37c6-4b84-8c3b-eb11ec7896b8 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74262) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  821.186810] env[74262]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f69a8aea-37c6-4b84-8c3b-eb11ec7896b8 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  821.186950] env[74262]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f69a8aea-37c6-4b84-8c3b-eb11ec7896b8 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=74262) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  823.189252] env[74262]: CRITICAL neutron [None req-f69a8aea-37c6-4b84-8c3b-eb11ec7896b8 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  823.189252] env[74262]: ERROR neutron Traceback (most recent call last):
[  823.189252] env[74262]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  823.189252] env[74262]: ERROR neutron     sys.exit(main())
[  823.189252] env[74262]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  823.189252] env[74262]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  823.189252] env[74262]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  823.189252] env[74262]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  823.189252] env[74262]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  823.189252] env[74262]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  823.189252] env[74262]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  823.189252] env[74262]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  823.189252] env[74262]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  823.189252] env[74262]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  823.189252] env[74262]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  823.189252] env[74262]: ERROR neutron     response = self.get(path=path, params=params)
[  823.190068] env[74262]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  823.190068] env[74262]: ERROR neutron     raise RuntimeError(msg, last_err)
[  823.190068] env[74262]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  823.190068] env[74262]: ERROR neutron 
[  825.735697] env[74322]: INFO neutron.common.config [-] Logging enabled!
[  825.736073] env[74322]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  825.736291] env[74322]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=74322) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  825.736514] env[74322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  825.736607] env[74322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  825.737449] env[74322]: WARNING oslo_policy.policy [None req-ff673bcc-811e-4a08-b3de-a473ac55cc6e None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  825.737673] env[74322]: WARNING oslo_policy.policy [None req-ff673bcc-811e-4a08-b3de-a473ac55cc6e None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  825.738903] env[74322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-ff673bcc-811e-4a08-b3de-a473ac55cc6e None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  825.752931] env[74322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ff673bcc-811e-4a08-b3de-a473ac55cc6e None None] Session token - acquiring
[  825.753697] env[74322]: DEBUG networking_nsxv3.common.locking [None req-ff673bcc-811e-4a08-b3de-a473ac55cc6e None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=74322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  825.753899] env[74322]: DEBUG oslo_concurrency.lockutils [None req-ff673bcc-811e-4a08-b3de-a473ac55cc6e None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  825.754029] env[74322]: DEBUG oslo_concurrency.lockutils [None req-ff673bcc-811e-4a08-b3de-a473ac55cc6e None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  825.754386] env[74322]: DEBUG oslo_concurrency.lockutils [None req-ff673bcc-811e-4a08-b3de-a473ac55cc6e None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  825.763518] env[74322]: DEBUG oslo_concurrency.lockutils [None req-ff673bcc-811e-4a08-b3de-a473ac55cc6e None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  825.763769] env[74322]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ff673bcc-811e-4a08-b3de-a473ac55cc6e None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  825.763920] env[74322]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ff673bcc-811e-4a08-b3de-a473ac55cc6e None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=74322) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  827.769931] env[74322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ff673bcc-811e-4a08-b3de-a473ac55cc6e None None] Session token - acquiring
[  827.770307] env[74322]: DEBUG networking_nsxv3.common.locking [None req-ff673bcc-811e-4a08-b3de-a473ac55cc6e None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=74322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  827.770687] env[74322]: DEBUG oslo_concurrency.lockutils [None req-ff673bcc-811e-4a08-b3de-a473ac55cc6e None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  827.770687] env[74322]: DEBUG oslo_concurrency.lockutils [None req-ff673bcc-811e-4a08-b3de-a473ac55cc6e None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  827.770903] env[74322]: DEBUG oslo_concurrency.lockutils [None req-ff673bcc-811e-4a08-b3de-a473ac55cc6e None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  827.779980] env[74322]: DEBUG oslo_concurrency.lockutils [None req-ff673bcc-811e-4a08-b3de-a473ac55cc6e None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  827.780246] env[74322]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ff673bcc-811e-4a08-b3de-a473ac55cc6e None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  827.780386] env[74322]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ff673bcc-811e-4a08-b3de-a473ac55cc6e None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=74322) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  829.783342] env[74322]: CRITICAL neutron [None req-ff673bcc-811e-4a08-b3de-a473ac55cc6e None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  829.783342] env[74322]: ERROR neutron Traceback (most recent call last):
[  829.783342] env[74322]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  829.783342] env[74322]: ERROR neutron     sys.exit(main())
[  829.783342] env[74322]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  829.783342] env[74322]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  829.783342] env[74322]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  829.783342] env[74322]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  829.783342] env[74322]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  829.783342] env[74322]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  829.783342] env[74322]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  829.783342] env[74322]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  829.783342] env[74322]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  829.783342] env[74322]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  829.783342] env[74322]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  829.783342] env[74322]: ERROR neutron     response = self.get(path=path, params=params)
[  829.784120] env[74322]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  829.784120] env[74322]: ERROR neutron     raise RuntimeError(msg, last_err)
[  829.784120] env[74322]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  829.784120] env[74322]: ERROR neutron 
[  832.259850] env[74351]: INFO neutron.common.config [-] Logging enabled!
[  832.260175] env[74351]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  832.261250] env[74351]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=74351) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  832.261250] env[74351]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  832.261250] env[74351]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  832.261567] env[74351]: WARNING oslo_policy.policy [None req-57060118-3618-45c1-be6d-cc857724a375 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  832.261781] env[74351]: WARNING oslo_policy.policy [None req-57060118-3618-45c1-be6d-cc857724a375 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  832.262953] env[74351]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-57060118-3618-45c1-be6d-cc857724a375 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  832.277474] env[74351]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-57060118-3618-45c1-be6d-cc857724a375 None None] Session token - acquiring
[  832.278435] env[74351]: DEBUG networking_nsxv3.common.locking [None req-57060118-3618-45c1-be6d-cc857724a375 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=74351) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  832.278903] env[74351]: DEBUG oslo_concurrency.lockutils [None req-57060118-3618-45c1-be6d-cc857724a375 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74351) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  832.279121] env[74351]: DEBUG oslo_concurrency.lockutils [None req-57060118-3618-45c1-be6d-cc857724a375 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74351) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  832.279557] env[74351]: DEBUG oslo_concurrency.lockutils [None req-57060118-3618-45c1-be6d-cc857724a375 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74351) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  832.289292] env[74351]: DEBUG oslo_concurrency.lockutils [None req-57060118-3618-45c1-be6d-cc857724a375 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74351) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  832.289780] env[74351]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-57060118-3618-45c1-be6d-cc857724a375 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  832.290136] env[74351]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-57060118-3618-45c1-be6d-cc857724a375 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=74351) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  834.296074] env[74351]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-57060118-3618-45c1-be6d-cc857724a375 None None] Session token - acquiring
[  834.296398] env[74351]: DEBUG networking_nsxv3.common.locking [None req-57060118-3618-45c1-be6d-cc857724a375 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=74351) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  834.296595] env[74351]: DEBUG oslo_concurrency.lockutils [None req-57060118-3618-45c1-be6d-cc857724a375 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74351) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  834.296719] env[74351]: DEBUG oslo_concurrency.lockutils [None req-57060118-3618-45c1-be6d-cc857724a375 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74351) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  834.296997] env[74351]: DEBUG oslo_concurrency.lockutils [None req-57060118-3618-45c1-be6d-cc857724a375 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74351) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  834.305979] env[74351]: DEBUG oslo_concurrency.lockutils [None req-57060118-3618-45c1-be6d-cc857724a375 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74351) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  834.306222] env[74351]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-57060118-3618-45c1-be6d-cc857724a375 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  834.306368] env[74351]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-57060118-3618-45c1-be6d-cc857724a375 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=74351) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  836.308870] env[74351]: CRITICAL neutron [None req-57060118-3618-45c1-be6d-cc857724a375 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  836.308870] env[74351]: ERROR neutron Traceback (most recent call last):
[  836.308870] env[74351]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  836.308870] env[74351]: ERROR neutron     sys.exit(main())
[  836.308870] env[74351]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  836.308870] env[74351]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  836.308870] env[74351]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  836.308870] env[74351]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  836.308870] env[74351]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  836.308870] env[74351]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  836.308870] env[74351]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  836.308870] env[74351]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  836.308870] env[74351]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  836.308870] env[74351]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  836.308870] env[74351]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  836.308870] env[74351]: ERROR neutron     response = self.get(path=path, params=params)
[  836.309583] env[74351]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  836.309583] env[74351]: ERROR neutron     raise RuntimeError(msg, last_err)
[  836.309583] env[74351]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  836.309583] env[74351]: ERROR neutron 
[  839.025091] env[74421]: INFO neutron.common.config [-] Logging enabled!
[  839.025369] env[74421]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  839.025538] env[74421]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=74421) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  839.025791] env[74421]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  839.025856] env[74421]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  839.026704] env[74421]: WARNING oslo_policy.policy [None req-6ddf7b4d-f741-48bd-8ac3-63d8476146d1 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  839.026917] env[74421]: WARNING oslo_policy.policy [None req-6ddf7b4d-f741-48bd-8ac3-63d8476146d1 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  839.028184] env[74421]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-6ddf7b4d-f741-48bd-8ac3-63d8476146d1 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  839.042339] env[74421]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-6ddf7b4d-f741-48bd-8ac3-63d8476146d1 None None] Session token - acquiring
[  839.043143] env[74421]: DEBUG networking_nsxv3.common.locking [None req-6ddf7b4d-f741-48bd-8ac3-63d8476146d1 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=74421) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  839.043346] env[74421]: DEBUG oslo_concurrency.lockutils [None req-6ddf7b4d-f741-48bd-8ac3-63d8476146d1 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  839.043474] env[74421]: DEBUG oslo_concurrency.lockutils [None req-6ddf7b4d-f741-48bd-8ac3-63d8476146d1 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  839.043841] env[74421]: DEBUG oslo_concurrency.lockutils [None req-6ddf7b4d-f741-48bd-8ac3-63d8476146d1 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  839.052966] env[74421]: DEBUG oslo_concurrency.lockutils [None req-6ddf7b4d-f741-48bd-8ac3-63d8476146d1 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  839.053312] env[74421]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-6ddf7b4d-f741-48bd-8ac3-63d8476146d1 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  839.053515] env[74421]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-6ddf7b4d-f741-48bd-8ac3-63d8476146d1 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=74421) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  841.059482] env[74421]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-6ddf7b4d-f741-48bd-8ac3-63d8476146d1 None None] Session token - acquiring
[  841.059921] env[74421]: DEBUG networking_nsxv3.common.locking [None req-6ddf7b4d-f741-48bd-8ac3-63d8476146d1 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=74421) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  841.060133] env[74421]: DEBUG oslo_concurrency.lockutils [None req-6ddf7b4d-f741-48bd-8ac3-63d8476146d1 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  841.060272] env[74421]: DEBUG oslo_concurrency.lockutils [None req-6ddf7b4d-f741-48bd-8ac3-63d8476146d1 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  841.060547] env[74421]: DEBUG oslo_concurrency.lockutils [None req-6ddf7b4d-f741-48bd-8ac3-63d8476146d1 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  841.069338] env[74421]: DEBUG oslo_concurrency.lockutils [None req-6ddf7b4d-f741-48bd-8ac3-63d8476146d1 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74421) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  841.069577] env[74421]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-6ddf7b4d-f741-48bd-8ac3-63d8476146d1 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  841.069717] env[74421]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-6ddf7b4d-f741-48bd-8ac3-63d8476146d1 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=74421) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  843.072634] env[74421]: CRITICAL neutron [None req-6ddf7b4d-f741-48bd-8ac3-63d8476146d1 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  843.072634] env[74421]: ERROR neutron Traceback (most recent call last):
[  843.072634] env[74421]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  843.072634] env[74421]: ERROR neutron     sys.exit(main())
[  843.072634] env[74421]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  843.072634] env[74421]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  843.072634] env[74421]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  843.072634] env[74421]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  843.072634] env[74421]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  843.072634] env[74421]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  843.072634] env[74421]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  843.072634] env[74421]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  843.072634] env[74421]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  843.072634] env[74421]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  843.072634] env[74421]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  843.072634] env[74421]: ERROR neutron     response = self.get(path=path, params=params)
[  843.073350] env[74421]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  843.073350] env[74421]: ERROR neutron     raise RuntimeError(msg, last_err)
[  843.073350] env[74421]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  843.073350] env[74421]: ERROR neutron 
[  845.469586] env[74487]: INFO neutron.common.config [-] Logging enabled!
[  845.470006] env[74487]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  845.470156] env[74487]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=74487) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  845.470369] env[74487]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  845.470462] env[74487]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  845.471285] env[74487]: WARNING oslo_policy.policy [None req-6559a607-294b-4f44-9401-d4138c7053e7 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  845.471500] env[74487]: WARNING oslo_policy.policy [None req-6559a607-294b-4f44-9401-d4138c7053e7 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  845.472716] env[74487]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-6559a607-294b-4f44-9401-d4138c7053e7 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  845.486680] env[74487]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-6559a607-294b-4f44-9401-d4138c7053e7 None None] Session token - acquiring
[  845.487413] env[74487]: DEBUG networking_nsxv3.common.locking [None req-6559a607-294b-4f44-9401-d4138c7053e7 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=74487) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  845.487610] env[74487]: DEBUG oslo_concurrency.lockutils [None req-6559a607-294b-4f44-9401-d4138c7053e7 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74487) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  845.487736] env[74487]: DEBUG oslo_concurrency.lockutils [None req-6559a607-294b-4f44-9401-d4138c7053e7 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74487) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  845.488099] env[74487]: DEBUG oslo_concurrency.lockutils [None req-6559a607-294b-4f44-9401-d4138c7053e7 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74487) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  845.496993] env[74487]: DEBUG oslo_concurrency.lockutils [None req-6559a607-294b-4f44-9401-d4138c7053e7 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74487) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  845.497224] env[74487]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-6559a607-294b-4f44-9401-d4138c7053e7 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  845.497372] env[74487]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-6559a607-294b-4f44-9401-d4138c7053e7 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=74487) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  847.504947] env[74487]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-6559a607-294b-4f44-9401-d4138c7053e7 None None] Session token - acquiring
[  847.504947] env[74487]: DEBUG networking_nsxv3.common.locking [None req-6559a607-294b-4f44-9401-d4138c7053e7 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=74487) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  847.504947] env[74487]: DEBUG oslo_concurrency.lockutils [None req-6559a607-294b-4f44-9401-d4138c7053e7 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74487) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  847.505393] env[74487]: DEBUG oslo_concurrency.lockutils [None req-6559a607-294b-4f44-9401-d4138c7053e7 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74487) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  847.505393] env[74487]: DEBUG oslo_concurrency.lockutils [None req-6559a607-294b-4f44-9401-d4138c7053e7 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74487) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  847.513831] env[74487]: DEBUG oslo_concurrency.lockutils [None req-6559a607-294b-4f44-9401-d4138c7053e7 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74487) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  847.514066] env[74487]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-6559a607-294b-4f44-9401-d4138c7053e7 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  847.514204] env[74487]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-6559a607-294b-4f44-9401-d4138c7053e7 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=74487) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  849.516916] env[74487]: CRITICAL neutron [None req-6559a607-294b-4f44-9401-d4138c7053e7 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  849.516916] env[74487]: ERROR neutron Traceback (most recent call last):
[  849.516916] env[74487]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  849.516916] env[74487]: ERROR neutron     sys.exit(main())
[  849.516916] env[74487]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  849.516916] env[74487]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  849.516916] env[74487]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  849.516916] env[74487]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  849.516916] env[74487]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  849.516916] env[74487]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  849.516916] env[74487]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  849.516916] env[74487]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  849.516916] env[74487]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  849.516916] env[74487]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  849.516916] env[74487]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  849.516916] env[74487]: ERROR neutron     response = self.get(path=path, params=params)
[  849.517568] env[74487]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  849.517568] env[74487]: ERROR neutron     raise RuntimeError(msg, last_err)
[  849.517568] env[74487]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  849.517568] env[74487]: ERROR neutron 
[  852.235568] env[74543]: INFO neutron.common.config [-] Logging enabled!
[  852.235899] env[74543]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  852.236109] env[74543]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=74543) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  852.236342] env[74543]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  852.236551] env[74543]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  852.237280] env[74543]: WARNING oslo_policy.policy [None req-e293867b-c3e8-40c5-9eb7-a1a8636c776d None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  852.237492] env[74543]: WARNING oslo_policy.policy [None req-e293867b-c3e8-40c5-9eb7-a1a8636c776d None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  852.238732] env[74543]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-e293867b-c3e8-40c5-9eb7-a1a8636c776d None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  852.253115] env[74543]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e293867b-c3e8-40c5-9eb7-a1a8636c776d None None] Session token - acquiring
[  852.257296] env[74543]: DEBUG networking_nsxv3.common.locking [None req-e293867b-c3e8-40c5-9eb7-a1a8636c776d None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=74543) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  852.257296] env[74543]: DEBUG oslo_concurrency.lockutils [None req-e293867b-c3e8-40c5-9eb7-a1a8636c776d None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74543) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  852.257468] env[74543]: DEBUG oslo_concurrency.lockutils [None req-e293867b-c3e8-40c5-9eb7-a1a8636c776d None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74543) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  852.257468] env[74543]: DEBUG oslo_concurrency.lockutils [None req-e293867b-c3e8-40c5-9eb7-a1a8636c776d None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74543) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  852.265497] env[74543]: DEBUG oslo_concurrency.lockutils [None req-e293867b-c3e8-40c5-9eb7-a1a8636c776d None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74543) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  852.265497] env[74543]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e293867b-c3e8-40c5-9eb7-a1a8636c776d None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  852.265710] env[74543]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e293867b-c3e8-40c5-9eb7-a1a8636c776d None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=74543) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  854.273678] env[74543]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e293867b-c3e8-40c5-9eb7-a1a8636c776d None None] Session token - acquiring
[  854.274062] env[74543]: DEBUG networking_nsxv3.common.locking [None req-e293867b-c3e8-40c5-9eb7-a1a8636c776d None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=74543) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  854.274257] env[74543]: DEBUG oslo_concurrency.lockutils [None req-e293867b-c3e8-40c5-9eb7-a1a8636c776d None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74543) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  854.274439] env[74543]: DEBUG oslo_concurrency.lockutils [None req-e293867b-c3e8-40c5-9eb7-a1a8636c776d None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74543) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  854.274662] env[74543]: DEBUG oslo_concurrency.lockutils [None req-e293867b-c3e8-40c5-9eb7-a1a8636c776d None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74543) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  854.283957] env[74543]: DEBUG oslo_concurrency.lockutils [None req-e293867b-c3e8-40c5-9eb7-a1a8636c776d None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74543) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  854.284228] env[74543]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e293867b-c3e8-40c5-9eb7-a1a8636c776d None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  854.284374] env[74543]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e293867b-c3e8-40c5-9eb7-a1a8636c776d None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=74543) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  856.287378] env[74543]: CRITICAL neutron [None req-e293867b-c3e8-40c5-9eb7-a1a8636c776d None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  856.287378] env[74543]: ERROR neutron Traceback (most recent call last):
[  856.287378] env[74543]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  856.287378] env[74543]: ERROR neutron     sys.exit(main())
[  856.287378] env[74543]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  856.287378] env[74543]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  856.287378] env[74543]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  856.287378] env[74543]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  856.287378] env[74543]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  856.287378] env[74543]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  856.287378] env[74543]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  856.287378] env[74543]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  856.287378] env[74543]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  856.287378] env[74543]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  856.287378] env[74543]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  856.287378] env[74543]: ERROR neutron     response = self.get(path=path, params=params)
[  856.288037] env[74543]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  856.288037] env[74543]: ERROR neutron     raise RuntimeError(msg, last_err)
[  856.288037] env[74543]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  856.288037] env[74543]: ERROR neutron 
[  859.090806] env[74832]: INFO neutron.common.config [-] Logging enabled!
[  859.091224] env[74832]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  859.091392] env[74832]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=74832) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  859.091623] env[74832]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  859.091711] env[74832]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  859.092662] env[74832]: WARNING oslo_policy.policy [None req-f6c71274-6f53-4267-aec7-db030fe1ca24 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  859.092888] env[74832]: WARNING oslo_policy.policy [None req-f6c71274-6f53-4267-aec7-db030fe1ca24 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  859.094120] env[74832]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-f6c71274-6f53-4267-aec7-db030fe1ca24 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  859.108517] env[74832]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f6c71274-6f53-4267-aec7-db030fe1ca24 None None] Session token - acquiring
[  859.109402] env[74832]: DEBUG networking_nsxv3.common.locking [None req-f6c71274-6f53-4267-aec7-db030fe1ca24 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=74832) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  859.109592] env[74832]: DEBUG oslo_concurrency.lockutils [None req-f6c71274-6f53-4267-aec7-db030fe1ca24 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74832) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  859.109722] env[74832]: DEBUG oslo_concurrency.lockutils [None req-f6c71274-6f53-4267-aec7-db030fe1ca24 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74832) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  859.110136] env[74832]: DEBUG oslo_concurrency.lockutils [None req-f6c71274-6f53-4267-aec7-db030fe1ca24 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74832) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  859.119351] env[74832]: DEBUG oslo_concurrency.lockutils [None req-f6c71274-6f53-4267-aec7-db030fe1ca24 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74832) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  859.119616] env[74832]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f6c71274-6f53-4267-aec7-db030fe1ca24 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  859.119769] env[74832]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f6c71274-6f53-4267-aec7-db030fe1ca24 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=74832) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  861.132132] env[74832]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f6c71274-6f53-4267-aec7-db030fe1ca24 None None] Session token - acquiring
[  861.132132] env[74832]: DEBUG networking_nsxv3.common.locking [None req-f6c71274-6f53-4267-aec7-db030fe1ca24 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=74832) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  861.132132] env[74832]: DEBUG oslo_concurrency.lockutils [None req-f6c71274-6f53-4267-aec7-db030fe1ca24 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74832) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  861.134561] env[74832]: DEBUG oslo_concurrency.lockutils [None req-f6c71274-6f53-4267-aec7-db030fe1ca24 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74832) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  861.134561] env[74832]: DEBUG oslo_concurrency.lockutils [None req-f6c71274-6f53-4267-aec7-db030fe1ca24 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74832) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  861.139329] env[74832]: DEBUG oslo_concurrency.lockutils [None req-f6c71274-6f53-4267-aec7-db030fe1ca24 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74832) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  861.139624] env[74832]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f6c71274-6f53-4267-aec7-db030fe1ca24 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  861.139804] env[74832]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f6c71274-6f53-4267-aec7-db030fe1ca24 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=74832) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  863.140900] env[74832]: CRITICAL neutron [None req-f6c71274-6f53-4267-aec7-db030fe1ca24 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  863.140900] env[74832]: ERROR neutron Traceback (most recent call last):
[  863.140900] env[74832]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  863.140900] env[74832]: ERROR neutron     sys.exit(main())
[  863.140900] env[74832]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  863.140900] env[74832]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  863.140900] env[74832]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  863.140900] env[74832]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  863.140900] env[74832]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  863.140900] env[74832]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  863.140900] env[74832]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  863.140900] env[74832]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  863.140900] env[74832]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  863.140900] env[74832]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  863.140900] env[74832]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  863.140900] env[74832]: ERROR neutron     response = self.get(path=path, params=params)
[  863.141558] env[74832]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  863.141558] env[74832]: ERROR neutron     raise RuntimeError(msg, last_err)
[  863.141558] env[74832]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  863.141558] env[74832]: ERROR neutron 
[  865.814184] env[74926]: INFO neutron.common.config [-] Logging enabled!
[  865.814521] env[74926]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  865.814735] env[74926]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=74926) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  865.815071] env[74926]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  865.815071] env[74926]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  865.815925] env[74926]: WARNING oslo_policy.policy [None req-586b2023-b970-44a8-be64-e8670502f71f None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  865.816154] env[74926]: WARNING oslo_policy.policy [None req-586b2023-b970-44a8-be64-e8670502f71f None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  865.817844] env[74926]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-586b2023-b970-44a8-be64-e8670502f71f None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  865.831870] env[74926]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-586b2023-b970-44a8-be64-e8670502f71f None None] Session token - acquiring
[  865.832687] env[74926]: DEBUG networking_nsxv3.common.locking [None req-586b2023-b970-44a8-be64-e8670502f71f None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=74926) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  865.832892] env[74926]: DEBUG oslo_concurrency.lockutils [None req-586b2023-b970-44a8-be64-e8670502f71f None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74926) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  865.833022] env[74926]: DEBUG oslo_concurrency.lockutils [None req-586b2023-b970-44a8-be64-e8670502f71f None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74926) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  865.833389] env[74926]: DEBUG oslo_concurrency.lockutils [None req-586b2023-b970-44a8-be64-e8670502f71f None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74926) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  865.842719] env[74926]: DEBUG oslo_concurrency.lockutils [None req-586b2023-b970-44a8-be64-e8670502f71f None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74926) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  865.842974] env[74926]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-586b2023-b970-44a8-be64-e8670502f71f None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  865.843130] env[74926]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-586b2023-b970-44a8-be64-e8670502f71f None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=74926) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  867.849779] env[74926]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-586b2023-b970-44a8-be64-e8670502f71f None None] Session token - acquiring
[  867.850231] env[74926]: DEBUG networking_nsxv3.common.locking [None req-586b2023-b970-44a8-be64-e8670502f71f None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=74926) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  867.850501] env[74926]: DEBUG oslo_concurrency.lockutils [None req-586b2023-b970-44a8-be64-e8670502f71f None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74926) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  867.850669] env[74926]: DEBUG oslo_concurrency.lockutils [None req-586b2023-b970-44a8-be64-e8670502f71f None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74926) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  867.851054] env[74926]: DEBUG oslo_concurrency.lockutils [None req-586b2023-b970-44a8-be64-e8670502f71f None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74926) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  867.863681] env[74926]: DEBUG oslo_concurrency.lockutils [None req-586b2023-b970-44a8-be64-e8670502f71f None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=74926) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  867.863681] env[74926]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-586b2023-b970-44a8-be64-e8670502f71f None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  867.863681] env[74926]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-586b2023-b970-44a8-be64-e8670502f71f None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=74926) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  869.864909] env[74926]: CRITICAL neutron [None req-586b2023-b970-44a8-be64-e8670502f71f None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  869.864909] env[74926]: ERROR neutron Traceback (most recent call last):
[  869.864909] env[74926]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  869.864909] env[74926]: ERROR neutron     sys.exit(main())
[  869.864909] env[74926]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  869.864909] env[74926]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  869.864909] env[74926]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  869.864909] env[74926]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  869.864909] env[74926]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  869.864909] env[74926]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  869.864909] env[74926]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  869.864909] env[74926]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  869.864909] env[74926]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  869.864909] env[74926]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  869.864909] env[74926]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  869.864909] env[74926]: ERROR neutron     response = self.get(path=path, params=params)
[  869.865634] env[74926]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  869.865634] env[74926]: ERROR neutron     raise RuntimeError(msg, last_err)
[  869.865634] env[74926]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  869.865634] env[74926]: ERROR neutron 
[  872.478406] env[75022]: INFO neutron.common.config [-] Logging enabled!
[  872.478856] env[75022]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  872.478898] env[75022]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=75022) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  872.479112] env[75022]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  872.479207] env[75022]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  872.480059] env[75022]: WARNING oslo_policy.policy [None req-5bb0da6e-4967-486b-a262-84ac19c3a68a None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  872.480284] env[75022]: WARNING oslo_policy.policy [None req-5bb0da6e-4967-486b-a262-84ac19c3a68a None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  872.481509] env[75022]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-5bb0da6e-4967-486b-a262-84ac19c3a68a None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  872.495113] env[75022]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5bb0da6e-4967-486b-a262-84ac19c3a68a None None] Session token - acquiring
[  872.496085] env[75022]: DEBUG networking_nsxv3.common.locking [None req-5bb0da6e-4967-486b-a262-84ac19c3a68a None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=75022) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  872.496085] env[75022]: DEBUG oslo_concurrency.lockutils [None req-5bb0da6e-4967-486b-a262-84ac19c3a68a None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75022) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  872.496192] env[75022]: DEBUG oslo_concurrency.lockutils [None req-5bb0da6e-4967-486b-a262-84ac19c3a68a None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75022) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  872.496538] env[75022]: DEBUG oslo_concurrency.lockutils [None req-5bb0da6e-4967-486b-a262-84ac19c3a68a None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75022) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  872.505337] env[75022]: DEBUG oslo_concurrency.lockutils [None req-5bb0da6e-4967-486b-a262-84ac19c3a68a None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75022) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  872.505585] env[75022]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5bb0da6e-4967-486b-a262-84ac19c3a68a None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  872.505733] env[75022]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5bb0da6e-4967-486b-a262-84ac19c3a68a None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=75022) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  874.513882] env[75022]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5bb0da6e-4967-486b-a262-84ac19c3a68a None None] Session token - acquiring
[  874.514298] env[75022]: DEBUG networking_nsxv3.common.locking [None req-5bb0da6e-4967-486b-a262-84ac19c3a68a None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=75022) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  874.514497] env[75022]: DEBUG oslo_concurrency.lockutils [None req-5bb0da6e-4967-486b-a262-84ac19c3a68a None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75022) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  874.514619] env[75022]: DEBUG oslo_concurrency.lockutils [None req-5bb0da6e-4967-486b-a262-84ac19c3a68a None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75022) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  874.514960] env[75022]: DEBUG oslo_concurrency.lockutils [None req-5bb0da6e-4967-486b-a262-84ac19c3a68a None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75022) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  874.524287] env[75022]: DEBUG oslo_concurrency.lockutils [None req-5bb0da6e-4967-486b-a262-84ac19c3a68a None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75022) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  874.524594] env[75022]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5bb0da6e-4967-486b-a262-84ac19c3a68a None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  874.524740] env[75022]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5bb0da6e-4967-486b-a262-84ac19c3a68a None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=75022) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  876.527763] env[75022]: CRITICAL neutron [None req-5bb0da6e-4967-486b-a262-84ac19c3a68a None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  876.527763] env[75022]: ERROR neutron Traceback (most recent call last):
[  876.527763] env[75022]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  876.527763] env[75022]: ERROR neutron     sys.exit(main())
[  876.527763] env[75022]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  876.527763] env[75022]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  876.527763] env[75022]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  876.527763] env[75022]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  876.527763] env[75022]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  876.527763] env[75022]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  876.527763] env[75022]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  876.527763] env[75022]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  876.527763] env[75022]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  876.527763] env[75022]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  876.527763] env[75022]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  876.527763] env[75022]: ERROR neutron     response = self.get(path=path, params=params)
[  876.528466] env[75022]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  876.528466] env[75022]: ERROR neutron     raise RuntimeError(msg, last_err)
[  876.528466] env[75022]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  876.528466] env[75022]: ERROR neutron 
[  879.135418] env[75084]: INFO neutron.common.config [-] Logging enabled!
[  879.135770] env[75084]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  879.135942] env[75084]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=75084) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  879.136229] env[75084]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  879.136323] env[75084]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  879.137146] env[75084]: WARNING oslo_policy.policy [None req-579b4b63-8aec-4b8d-8128-edb6bc9c715d None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  879.137364] env[75084]: WARNING oslo_policy.policy [None req-579b4b63-8aec-4b8d-8128-edb6bc9c715d None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  879.138562] env[75084]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-579b4b63-8aec-4b8d-8128-edb6bc9c715d None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  879.152673] env[75084]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-579b4b63-8aec-4b8d-8128-edb6bc9c715d None None] Session token - acquiring
[  879.153465] env[75084]: DEBUG networking_nsxv3.common.locking [None req-579b4b63-8aec-4b8d-8128-edb6bc9c715d None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=75084) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  879.153670] env[75084]: DEBUG oslo_concurrency.lockutils [None req-579b4b63-8aec-4b8d-8128-edb6bc9c715d None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75084) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  879.153797] env[75084]: DEBUG oslo_concurrency.lockutils [None req-579b4b63-8aec-4b8d-8128-edb6bc9c715d None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75084) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  879.154160] env[75084]: DEBUG oslo_concurrency.lockutils [None req-579b4b63-8aec-4b8d-8128-edb6bc9c715d None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75084) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  879.163222] env[75084]: DEBUG oslo_concurrency.lockutils [None req-579b4b63-8aec-4b8d-8128-edb6bc9c715d None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75084) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  879.163475] env[75084]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-579b4b63-8aec-4b8d-8128-edb6bc9c715d None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  879.163676] env[75084]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-579b4b63-8aec-4b8d-8128-edb6bc9c715d None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=75084) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  881.169619] env[75084]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-579b4b63-8aec-4b8d-8128-edb6bc9c715d None None] Session token - acquiring
[  881.170041] env[75084]: DEBUG networking_nsxv3.common.locking [None req-579b4b63-8aec-4b8d-8128-edb6bc9c715d None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=75084) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  881.170198] env[75084]: DEBUG oslo_concurrency.lockutils [None req-579b4b63-8aec-4b8d-8128-edb6bc9c715d None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75084) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  881.170309] env[75084]: DEBUG oslo_concurrency.lockutils [None req-579b4b63-8aec-4b8d-8128-edb6bc9c715d None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75084) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  881.170576] env[75084]: DEBUG oslo_concurrency.lockutils [None req-579b4b63-8aec-4b8d-8128-edb6bc9c715d None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75084) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  881.179366] env[75084]: DEBUG oslo_concurrency.lockutils [None req-579b4b63-8aec-4b8d-8128-edb6bc9c715d None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75084) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  881.179595] env[75084]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-579b4b63-8aec-4b8d-8128-edb6bc9c715d None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  881.179734] env[75084]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-579b4b63-8aec-4b8d-8128-edb6bc9c715d None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=75084) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  883.181174] env[75084]: CRITICAL neutron [None req-579b4b63-8aec-4b8d-8128-edb6bc9c715d None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  883.181174] env[75084]: ERROR neutron Traceback (most recent call last):
[  883.181174] env[75084]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  883.181174] env[75084]: ERROR neutron     sys.exit(main())
[  883.181174] env[75084]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  883.181174] env[75084]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  883.181174] env[75084]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  883.181174] env[75084]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  883.181174] env[75084]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  883.181174] env[75084]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  883.181174] env[75084]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  883.181174] env[75084]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  883.181174] env[75084]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  883.181174] env[75084]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  883.181174] env[75084]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  883.181174] env[75084]: ERROR neutron     response = self.get(path=path, params=params)
[  883.181914] env[75084]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  883.181914] env[75084]: ERROR neutron     raise RuntimeError(msg, last_err)
[  883.181914] env[75084]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  883.181914] env[75084]: ERROR neutron 
[  885.780185] env[75116]: INFO neutron.common.config [-] Logging enabled!
[  885.780492] env[75116]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  885.780726] env[75116]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=75116) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  885.780951] env[75116]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  885.781078] env[75116]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  885.782106] env[75116]: WARNING oslo_policy.policy [None req-78fd20ec-99e9-4241-b7d3-900eaa1e419d None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  885.782322] env[75116]: WARNING oslo_policy.policy [None req-78fd20ec-99e9-4241-b7d3-900eaa1e419d None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  885.784073] env[75116]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-78fd20ec-99e9-4241-b7d3-900eaa1e419d None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  885.798036] env[75116]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-78fd20ec-99e9-4241-b7d3-900eaa1e419d None None] Session token - acquiring
[  885.798850] env[75116]: DEBUG networking_nsxv3.common.locking [None req-78fd20ec-99e9-4241-b7d3-900eaa1e419d None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=75116) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  885.799781] env[75116]: DEBUG oslo_concurrency.lockutils [None req-78fd20ec-99e9-4241-b7d3-900eaa1e419d None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75116) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  885.799781] env[75116]: DEBUG oslo_concurrency.lockutils [None req-78fd20ec-99e9-4241-b7d3-900eaa1e419d None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75116) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  885.799781] env[75116]: DEBUG oslo_concurrency.lockutils [None req-78fd20ec-99e9-4241-b7d3-900eaa1e419d None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75116) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  885.809018] env[75116]: DEBUG oslo_concurrency.lockutils [None req-78fd20ec-99e9-4241-b7d3-900eaa1e419d None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75116) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  885.809284] env[75116]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-78fd20ec-99e9-4241-b7d3-900eaa1e419d None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  885.809436] env[75116]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-78fd20ec-99e9-4241-b7d3-900eaa1e419d None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=75116) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  887.818809] env[75116]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-78fd20ec-99e9-4241-b7d3-900eaa1e419d None None] Session token - acquiring
[  887.818809] env[75116]: DEBUG networking_nsxv3.common.locking [None req-78fd20ec-99e9-4241-b7d3-900eaa1e419d None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=75116) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  887.818809] env[75116]: DEBUG oslo_concurrency.lockutils [None req-78fd20ec-99e9-4241-b7d3-900eaa1e419d None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75116) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  887.819201] env[75116]: DEBUG oslo_concurrency.lockutils [None req-78fd20ec-99e9-4241-b7d3-900eaa1e419d None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75116) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  887.819201] env[75116]: DEBUG oslo_concurrency.lockutils [None req-78fd20ec-99e9-4241-b7d3-900eaa1e419d None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75116) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  887.827617] env[75116]: DEBUG oslo_concurrency.lockutils [None req-78fd20ec-99e9-4241-b7d3-900eaa1e419d None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75116) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  887.827739] env[75116]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-78fd20ec-99e9-4241-b7d3-900eaa1e419d None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  887.827911] env[75116]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-78fd20ec-99e9-4241-b7d3-900eaa1e419d None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=75116) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  889.828892] env[75116]: CRITICAL neutron [None req-78fd20ec-99e9-4241-b7d3-900eaa1e419d None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  889.828892] env[75116]: ERROR neutron Traceback (most recent call last):
[  889.828892] env[75116]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  889.828892] env[75116]: ERROR neutron     sys.exit(main())
[  889.828892] env[75116]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  889.828892] env[75116]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  889.828892] env[75116]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  889.828892] env[75116]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  889.828892] env[75116]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  889.828892] env[75116]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  889.828892] env[75116]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  889.828892] env[75116]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  889.828892] env[75116]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  889.828892] env[75116]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  889.828892] env[75116]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  889.828892] env[75116]: ERROR neutron     response = self.get(path=path, params=params)
[  889.829519] env[75116]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  889.829519] env[75116]: ERROR neutron     raise RuntimeError(msg, last_err)
[  889.829519] env[75116]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  889.829519] env[75116]: ERROR neutron 
[  892.470766] env[75217]: INFO neutron.common.config [-] Logging enabled!
[  892.471083] env[75217]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  892.471350] env[75217]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=75217) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  892.471594] env[75217]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  892.471678] env[75217]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  892.472505] env[75217]: WARNING oslo_policy.policy [None req-2f90ce93-b761-4dfb-87ad-44afb87a80d7 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  892.472716] env[75217]: WARNING oslo_policy.policy [None req-2f90ce93-b761-4dfb-87ad-44afb87a80d7 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  892.476237] env[75217]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-2f90ce93-b761-4dfb-87ad-44afb87a80d7 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  892.492494] env[75217]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-2f90ce93-b761-4dfb-87ad-44afb87a80d7 None None] Session token - acquiring
[  892.493327] env[75217]: DEBUG networking_nsxv3.common.locking [None req-2f90ce93-b761-4dfb-87ad-44afb87a80d7 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=75217) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  892.493596] env[75217]: DEBUG oslo_concurrency.lockutils [None req-2f90ce93-b761-4dfb-87ad-44afb87a80d7 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75217) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  892.493658] env[75217]: DEBUG oslo_concurrency.lockutils [None req-2f90ce93-b761-4dfb-87ad-44afb87a80d7 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75217) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  892.494029] env[75217]: DEBUG oslo_concurrency.lockutils [None req-2f90ce93-b761-4dfb-87ad-44afb87a80d7 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75217) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  892.503044] env[75217]: DEBUG oslo_concurrency.lockutils [None req-2f90ce93-b761-4dfb-87ad-44afb87a80d7 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75217) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  892.503297] env[75217]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-2f90ce93-b761-4dfb-87ad-44afb87a80d7 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  892.503449] env[75217]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-2f90ce93-b761-4dfb-87ad-44afb87a80d7 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=75217) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  894.509502] env[75217]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-2f90ce93-b761-4dfb-87ad-44afb87a80d7 None None] Session token - acquiring
[  894.509799] env[75217]: DEBUG networking_nsxv3.common.locking [None req-2f90ce93-b761-4dfb-87ad-44afb87a80d7 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=75217) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  894.510015] env[75217]: DEBUG oslo_concurrency.lockutils [None req-2f90ce93-b761-4dfb-87ad-44afb87a80d7 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75217) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  894.510147] env[75217]: DEBUG oslo_concurrency.lockutils [None req-2f90ce93-b761-4dfb-87ad-44afb87a80d7 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75217) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  894.510410] env[75217]: DEBUG oslo_concurrency.lockutils [None req-2f90ce93-b761-4dfb-87ad-44afb87a80d7 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75217) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  894.519493] env[75217]: DEBUG oslo_concurrency.lockutils [None req-2f90ce93-b761-4dfb-87ad-44afb87a80d7 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75217) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  894.519723] env[75217]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-2f90ce93-b761-4dfb-87ad-44afb87a80d7 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  894.519863] env[75217]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-2f90ce93-b761-4dfb-87ad-44afb87a80d7 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=75217) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  896.534646] env[75217]: CRITICAL neutron [None req-2f90ce93-b761-4dfb-87ad-44afb87a80d7 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  896.534646] env[75217]: ERROR neutron Traceback (most recent call last):
[  896.534646] env[75217]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  896.534646] env[75217]: ERROR neutron     sys.exit(main())
[  896.534646] env[75217]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  896.534646] env[75217]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  896.534646] env[75217]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  896.534646] env[75217]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  896.534646] env[75217]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  896.534646] env[75217]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  896.534646] env[75217]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  896.534646] env[75217]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  896.534646] env[75217]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  896.534646] env[75217]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  896.534646] env[75217]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  896.534646] env[75217]: ERROR neutron     response = self.get(path=path, params=params)
[  896.535339] env[75217]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  896.535339] env[75217]: ERROR neutron     raise RuntimeError(msg, last_err)
[  896.535339] env[75217]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  896.535339] env[75217]: ERROR neutron 
[  899.305313] env[75287]: INFO neutron.common.config [-] Logging enabled!
[  899.305631] env[75287]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  899.305827] env[75287]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=75287) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  899.306046] env[75287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  899.306136] env[75287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  899.306967] env[75287]: WARNING oslo_policy.policy [None req-dddf665b-20ef-437f-86e4-f71ab088fdbe None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  899.307171] env[75287]: WARNING oslo_policy.policy [None req-dddf665b-20ef-437f-86e4-f71ab088fdbe None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  899.308421] env[75287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-dddf665b-20ef-437f-86e4-f71ab088fdbe None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  899.323009] env[75287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-dddf665b-20ef-437f-86e4-f71ab088fdbe None None] Session token - acquiring
[  899.323813] env[75287]: DEBUG networking_nsxv3.common.locking [None req-dddf665b-20ef-437f-86e4-f71ab088fdbe None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=75287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  899.324023] env[75287]: DEBUG oslo_concurrency.lockutils [None req-dddf665b-20ef-437f-86e4-f71ab088fdbe None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  899.324145] env[75287]: DEBUG oslo_concurrency.lockutils [None req-dddf665b-20ef-437f-86e4-f71ab088fdbe None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  899.324557] env[75287]: DEBUG oslo_concurrency.lockutils [None req-dddf665b-20ef-437f-86e4-f71ab088fdbe None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  899.334072] env[75287]: DEBUG oslo_concurrency.lockutils [None req-dddf665b-20ef-437f-86e4-f71ab088fdbe None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  899.334324] env[75287]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-dddf665b-20ef-437f-86e4-f71ab088fdbe None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  899.334473] env[75287]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-dddf665b-20ef-437f-86e4-f71ab088fdbe None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=75287) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  901.340433] env[75287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-dddf665b-20ef-437f-86e4-f71ab088fdbe None None] Session token - acquiring
[  901.340745] env[75287]: DEBUG networking_nsxv3.common.locking [None req-dddf665b-20ef-437f-86e4-f71ab088fdbe None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=75287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  901.340921] env[75287]: DEBUG oslo_concurrency.lockutils [None req-dddf665b-20ef-437f-86e4-f71ab088fdbe None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  901.341076] env[75287]: DEBUG oslo_concurrency.lockutils [None req-dddf665b-20ef-437f-86e4-f71ab088fdbe None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  901.341372] env[75287]: DEBUG oslo_concurrency.lockutils [None req-dddf665b-20ef-437f-86e4-f71ab088fdbe None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  901.350284] env[75287]: DEBUG oslo_concurrency.lockutils [None req-dddf665b-20ef-437f-86e4-f71ab088fdbe None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  901.350513] env[75287]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-dddf665b-20ef-437f-86e4-f71ab088fdbe None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  901.350651] env[75287]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-dddf665b-20ef-437f-86e4-f71ab088fdbe None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=75287) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  903.352936] env[75287]: CRITICAL neutron [None req-dddf665b-20ef-437f-86e4-f71ab088fdbe None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  903.352936] env[75287]: ERROR neutron Traceback (most recent call last):
[  903.352936] env[75287]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  903.352936] env[75287]: ERROR neutron     sys.exit(main())
[  903.352936] env[75287]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  903.352936] env[75287]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  903.352936] env[75287]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  903.352936] env[75287]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  903.352936] env[75287]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  903.352936] env[75287]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  903.352936] env[75287]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  903.352936] env[75287]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  903.352936] env[75287]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  903.352936] env[75287]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  903.352936] env[75287]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  903.352936] env[75287]: ERROR neutron     response = self.get(path=path, params=params)
[  903.353828] env[75287]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  903.353828] env[75287]: ERROR neutron     raise RuntimeError(msg, last_err)
[  903.353828] env[75287]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  903.353828] env[75287]: ERROR neutron 
[  906.010563] env[75352]: INFO neutron.common.config [-] Logging enabled!
[  906.011071] env[75352]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  906.011547] env[75352]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=75352) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  906.011890] env[75352]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  906.012116] env[75352]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  906.013007] env[75352]: WARNING oslo_policy.policy [None req-0977603f-4f10-45c5-b236-1c8197502e7b None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  906.013357] env[75352]: WARNING oslo_policy.policy [None req-0977603f-4f10-45c5-b236-1c8197502e7b None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  906.014651] env[75352]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-0977603f-4f10-45c5-b236-1c8197502e7b None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  906.028866] env[75352]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-0977603f-4f10-45c5-b236-1c8197502e7b None None] Session token - acquiring
[  906.029697] env[75352]: DEBUG networking_nsxv3.common.locking [None req-0977603f-4f10-45c5-b236-1c8197502e7b None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=75352) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  906.030069] env[75352]: DEBUG oslo_concurrency.lockutils [None req-0977603f-4f10-45c5-b236-1c8197502e7b None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75352) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  906.030320] env[75352]: DEBUG oslo_concurrency.lockutils [None req-0977603f-4f10-45c5-b236-1c8197502e7b None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75352) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  906.030766] env[75352]: DEBUG oslo_concurrency.lockutils [None req-0977603f-4f10-45c5-b236-1c8197502e7b None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75352) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  906.039803] env[75352]: DEBUG oslo_concurrency.lockutils [None req-0977603f-4f10-45c5-b236-1c8197502e7b None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75352) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  906.040206] env[75352]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-0977603f-4f10-45c5-b236-1c8197502e7b None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  906.040465] env[75352]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-0977603f-4f10-45c5-b236-1c8197502e7b None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=75352) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  908.046549] env[75352]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-0977603f-4f10-45c5-b236-1c8197502e7b None None] Session token - acquiring
[  908.046861] env[75352]: DEBUG networking_nsxv3.common.locking [None req-0977603f-4f10-45c5-b236-1c8197502e7b None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=75352) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  908.047080] env[75352]: DEBUG oslo_concurrency.lockutils [None req-0977603f-4f10-45c5-b236-1c8197502e7b None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75352) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  908.047213] env[75352]: DEBUG oslo_concurrency.lockutils [None req-0977603f-4f10-45c5-b236-1c8197502e7b None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75352) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  908.047488] env[75352]: DEBUG oslo_concurrency.lockutils [None req-0977603f-4f10-45c5-b236-1c8197502e7b None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75352) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  908.056564] env[75352]: DEBUG oslo_concurrency.lockutils [None req-0977603f-4f10-45c5-b236-1c8197502e7b None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75352) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  908.056802] env[75352]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-0977603f-4f10-45c5-b236-1c8197502e7b None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  908.056943] env[75352]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-0977603f-4f10-45c5-b236-1c8197502e7b None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=75352) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  910.059303] env[75352]: CRITICAL neutron [None req-0977603f-4f10-45c5-b236-1c8197502e7b None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  910.059303] env[75352]: ERROR neutron Traceback (most recent call last):
[  910.059303] env[75352]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  910.059303] env[75352]: ERROR neutron     sys.exit(main())
[  910.059303] env[75352]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  910.059303] env[75352]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  910.059303] env[75352]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  910.059303] env[75352]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  910.059303] env[75352]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  910.059303] env[75352]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  910.059303] env[75352]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  910.059303] env[75352]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  910.059303] env[75352]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  910.059303] env[75352]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  910.059303] env[75352]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  910.059303] env[75352]: ERROR neutron     response = self.get(path=path, params=params)
[  910.060234] env[75352]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  910.060234] env[75352]: ERROR neutron     raise RuntimeError(msg, last_err)
[  910.060234] env[75352]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  910.060234] env[75352]: ERROR neutron 
[  912.626568] env[75381]: INFO neutron.common.config [-] Logging enabled!
[  912.627087] env[75381]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  912.627137] env[75381]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=75381) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  912.627341] env[75381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  912.627440] env[75381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  912.628410] env[75381]: WARNING oslo_policy.policy [None req-e4900c2b-612b-474f-9e47-4e1d18e90c11 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  912.628631] env[75381]: WARNING oslo_policy.policy [None req-e4900c2b-612b-474f-9e47-4e1d18e90c11 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  912.629859] env[75381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-e4900c2b-612b-474f-9e47-4e1d18e90c11 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  912.650701] env[75381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e4900c2b-612b-474f-9e47-4e1d18e90c11 None None] Session token - acquiring
[  912.652911] env[75381]: DEBUG networking_nsxv3.common.locking [None req-e4900c2b-612b-474f-9e47-4e1d18e90c11 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=75381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  912.652911] env[75381]: DEBUG oslo_concurrency.lockutils [None req-e4900c2b-612b-474f-9e47-4e1d18e90c11 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  912.653088] env[75381]: DEBUG oslo_concurrency.lockutils [None req-e4900c2b-612b-474f-9e47-4e1d18e90c11 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  912.653088] env[75381]: DEBUG oslo_concurrency.lockutils [None req-e4900c2b-612b-474f-9e47-4e1d18e90c11 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  912.665874] env[75381]: DEBUG oslo_concurrency.lockutils [None req-e4900c2b-612b-474f-9e47-4e1d18e90c11 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  912.666135] env[75381]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e4900c2b-612b-474f-9e47-4e1d18e90c11 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  912.666286] env[75381]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e4900c2b-612b-474f-9e47-4e1d18e90c11 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=75381) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  914.672547] env[75381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e4900c2b-612b-474f-9e47-4e1d18e90c11 None None] Session token - acquiring
[  914.672925] env[75381]: DEBUG networking_nsxv3.common.locking [None req-e4900c2b-612b-474f-9e47-4e1d18e90c11 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=75381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  914.673042] env[75381]: DEBUG oslo_concurrency.lockutils [None req-e4900c2b-612b-474f-9e47-4e1d18e90c11 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  914.673171] env[75381]: DEBUG oslo_concurrency.lockutils [None req-e4900c2b-612b-474f-9e47-4e1d18e90c11 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  914.673466] env[75381]: DEBUG oslo_concurrency.lockutils [None req-e4900c2b-612b-474f-9e47-4e1d18e90c11 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  914.683387] env[75381]: DEBUG oslo_concurrency.lockutils [None req-e4900c2b-612b-474f-9e47-4e1d18e90c11 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  914.683629] env[75381]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e4900c2b-612b-474f-9e47-4e1d18e90c11 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  914.683770] env[75381]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e4900c2b-612b-474f-9e47-4e1d18e90c11 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=75381) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  916.684908] env[75381]: CRITICAL neutron [None req-e4900c2b-612b-474f-9e47-4e1d18e90c11 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  916.684908] env[75381]: ERROR neutron Traceback (most recent call last):
[  916.684908] env[75381]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  916.684908] env[75381]: ERROR neutron     sys.exit(main())
[  916.684908] env[75381]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  916.684908] env[75381]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  916.684908] env[75381]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  916.684908] env[75381]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  916.684908] env[75381]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  916.684908] env[75381]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  916.684908] env[75381]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  916.684908] env[75381]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  916.684908] env[75381]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  916.684908] env[75381]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  916.684908] env[75381]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  916.684908] env[75381]: ERROR neutron     response = self.get(path=path, params=params)
[  916.685693] env[75381]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  916.685693] env[75381]: ERROR neutron     raise RuntimeError(msg, last_err)
[  916.685693] env[75381]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  916.685693] env[75381]: ERROR neutron 
[  919.396296] env[75520]: INFO neutron.common.config [-] Logging enabled!
[  919.396599] env[75520]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  919.396839] env[75520]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=75520) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  919.397090] env[75520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  919.397188] env[75520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  919.398064] env[75520]: WARNING oslo_policy.policy [None req-a70c7611-0db1-4b43-b05f-9a84ad5754a3 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  919.398301] env[75520]: WARNING oslo_policy.policy [None req-a70c7611-0db1-4b43-b05f-9a84ad5754a3 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  919.400905] env[75520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-a70c7611-0db1-4b43-b05f-9a84ad5754a3 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  919.413513] env[75520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-a70c7611-0db1-4b43-b05f-9a84ad5754a3 None None] Session token - acquiring
[  919.414308] env[75520]: DEBUG networking_nsxv3.common.locking [None req-a70c7611-0db1-4b43-b05f-9a84ad5754a3 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=75520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  919.414516] env[75520]: DEBUG oslo_concurrency.lockutils [None req-a70c7611-0db1-4b43-b05f-9a84ad5754a3 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  919.414645] env[75520]: DEBUG oslo_concurrency.lockutils [None req-a70c7611-0db1-4b43-b05f-9a84ad5754a3 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  919.415000] env[75520]: DEBUG oslo_concurrency.lockutils [None req-a70c7611-0db1-4b43-b05f-9a84ad5754a3 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  919.424067] env[75520]: DEBUG oslo_concurrency.lockutils [None req-a70c7611-0db1-4b43-b05f-9a84ad5754a3 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  919.424385] env[75520]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-a70c7611-0db1-4b43-b05f-9a84ad5754a3 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  919.424478] env[75520]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-a70c7611-0db1-4b43-b05f-9a84ad5754a3 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=75520) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  921.434847] env[75520]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-a70c7611-0db1-4b43-b05f-9a84ad5754a3 None None] Session token - acquiring
[  921.434847] env[75520]: DEBUG networking_nsxv3.common.locking [None req-a70c7611-0db1-4b43-b05f-9a84ad5754a3 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=75520) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  921.434847] env[75520]: DEBUG oslo_concurrency.lockutils [None req-a70c7611-0db1-4b43-b05f-9a84ad5754a3 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  921.435243] env[75520]: DEBUG oslo_concurrency.lockutils [None req-a70c7611-0db1-4b43-b05f-9a84ad5754a3 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  921.435243] env[75520]: DEBUG oslo_concurrency.lockutils [None req-a70c7611-0db1-4b43-b05f-9a84ad5754a3 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  921.443093] env[75520]: DEBUG oslo_concurrency.lockutils [None req-a70c7611-0db1-4b43-b05f-9a84ad5754a3 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  921.443498] env[75520]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-a70c7611-0db1-4b43-b05f-9a84ad5754a3 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  921.443766] env[75520]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-a70c7611-0db1-4b43-b05f-9a84ad5754a3 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=75520) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  923.444935] env[75520]: CRITICAL neutron [None req-a70c7611-0db1-4b43-b05f-9a84ad5754a3 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  923.444935] env[75520]: ERROR neutron Traceback (most recent call last):
[  923.444935] env[75520]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  923.444935] env[75520]: ERROR neutron     sys.exit(main())
[  923.444935] env[75520]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  923.444935] env[75520]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  923.444935] env[75520]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  923.444935] env[75520]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  923.444935] env[75520]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  923.444935] env[75520]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  923.444935] env[75520]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  923.444935] env[75520]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  923.444935] env[75520]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  923.444935] env[75520]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  923.444935] env[75520]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  923.444935] env[75520]: ERROR neutron     response = self.get(path=path, params=params)
[  923.445672] env[75520]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  923.445672] env[75520]: ERROR neutron     raise RuntimeError(msg, last_err)
[  923.445672] env[75520]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  923.445672] env[75520]: ERROR neutron 
[  926.053619] env[75771]: INFO neutron.common.config [-] Logging enabled!
[  926.053882] env[75771]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  926.054159] env[75771]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=75771) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  926.054401] env[75771]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  926.054491] env[75771]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  926.055342] env[75771]: WARNING oslo_policy.policy [None req-e7192f3b-f6fb-4d0e-9269-23ee956c5756 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  926.055563] env[75771]: WARNING oslo_policy.policy [None req-e7192f3b-f6fb-4d0e-9269-23ee956c5756 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  926.056798] env[75771]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-e7192f3b-f6fb-4d0e-9269-23ee956c5756 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  926.071517] env[75771]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e7192f3b-f6fb-4d0e-9269-23ee956c5756 None None] Session token - acquiring
[  926.072368] env[75771]: DEBUG networking_nsxv3.common.locking [None req-e7192f3b-f6fb-4d0e-9269-23ee956c5756 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=75771) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  926.072573] env[75771]: DEBUG oslo_concurrency.lockutils [None req-e7192f3b-f6fb-4d0e-9269-23ee956c5756 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75771) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  926.072700] env[75771]: DEBUG oslo_concurrency.lockutils [None req-e7192f3b-f6fb-4d0e-9269-23ee956c5756 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75771) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  926.073071] env[75771]: DEBUG oslo_concurrency.lockutils [None req-e7192f3b-f6fb-4d0e-9269-23ee956c5756 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75771) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  926.082620] env[75771]: DEBUG oslo_concurrency.lockutils [None req-e7192f3b-f6fb-4d0e-9269-23ee956c5756 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75771) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  926.082839] env[75771]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e7192f3b-f6fb-4d0e-9269-23ee956c5756 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  926.083015] env[75771]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e7192f3b-f6fb-4d0e-9269-23ee956c5756 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=75771) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  928.089461] env[75771]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e7192f3b-f6fb-4d0e-9269-23ee956c5756 None None] Session token - acquiring
[  928.089836] env[75771]: DEBUG networking_nsxv3.common.locking [None req-e7192f3b-f6fb-4d0e-9269-23ee956c5756 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=75771) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  928.090060] env[75771]: DEBUG oslo_concurrency.lockutils [None req-e7192f3b-f6fb-4d0e-9269-23ee956c5756 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75771) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  928.090208] env[75771]: DEBUG oslo_concurrency.lockutils [None req-e7192f3b-f6fb-4d0e-9269-23ee956c5756 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75771) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  928.090479] env[75771]: DEBUG oslo_concurrency.lockutils [None req-e7192f3b-f6fb-4d0e-9269-23ee956c5756 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75771) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  928.100373] env[75771]: DEBUG oslo_concurrency.lockutils [None req-e7192f3b-f6fb-4d0e-9269-23ee956c5756 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=75771) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  928.100534] env[75771]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e7192f3b-f6fb-4d0e-9269-23ee956c5756 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  928.100704] env[75771]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e7192f3b-f6fb-4d0e-9269-23ee956c5756 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=75771) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  930.103632] env[75771]: CRITICAL neutron [None req-e7192f3b-f6fb-4d0e-9269-23ee956c5756 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  930.103632] env[75771]: ERROR neutron Traceback (most recent call last):
[  930.103632] env[75771]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  930.103632] env[75771]: ERROR neutron     sys.exit(main())
[  930.103632] env[75771]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  930.103632] env[75771]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  930.103632] env[75771]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  930.103632] env[75771]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  930.103632] env[75771]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  930.103632] env[75771]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  930.103632] env[75771]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  930.103632] env[75771]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  930.103632] env[75771]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  930.103632] env[75771]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  930.103632] env[75771]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  930.103632] env[75771]: ERROR neutron     response = self.get(path=path, params=params)
[  930.104421] env[75771]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  930.104421] env[75771]: ERROR neutron     raise RuntimeError(msg, last_err)
[  930.104421] env[75771]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  930.104421] env[75771]: ERROR neutron 
[  932.774105] env[76012]: INFO neutron.common.config [-] Logging enabled!
[  932.774421] env[76012]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  932.774654] env[76012]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=76012) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  932.774898] env[76012]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  932.774995] env[76012]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  932.779065] env[76012]: WARNING oslo_policy.policy [None req-3ed10a93-559d-4305-9485-dd93c122c762 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  932.779065] env[76012]: WARNING oslo_policy.policy [None req-3ed10a93-559d-4305-9485-dd93c122c762 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  932.779065] env[76012]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-3ed10a93-559d-4305-9485-dd93c122c762 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  932.792317] env[76012]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3ed10a93-559d-4305-9485-dd93c122c762 None None] Session token - acquiring
[  932.793613] env[76012]: DEBUG networking_nsxv3.common.locking [None req-3ed10a93-559d-4305-9485-dd93c122c762 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=76012) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  932.793613] env[76012]: DEBUG oslo_concurrency.lockutils [None req-3ed10a93-559d-4305-9485-dd93c122c762 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  932.793894] env[76012]: DEBUG oslo_concurrency.lockutils [None req-3ed10a93-559d-4305-9485-dd93c122c762 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  932.793994] env[76012]: DEBUG oslo_concurrency.lockutils [None req-3ed10a93-559d-4305-9485-dd93c122c762 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  932.803413] env[76012]: DEBUG oslo_concurrency.lockutils [None req-3ed10a93-559d-4305-9485-dd93c122c762 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  932.803764] env[76012]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3ed10a93-559d-4305-9485-dd93c122c762 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  932.804110] env[76012]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3ed10a93-559d-4305-9485-dd93c122c762 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=76012) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  934.810363] env[76012]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3ed10a93-559d-4305-9485-dd93c122c762 None None] Session token - acquiring
[  934.810697] env[76012]: DEBUG networking_nsxv3.common.locking [None req-3ed10a93-559d-4305-9485-dd93c122c762 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=76012) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  934.810909] env[76012]: DEBUG oslo_concurrency.lockutils [None req-3ed10a93-559d-4305-9485-dd93c122c762 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  934.811050] env[76012]: DEBUG oslo_concurrency.lockutils [None req-3ed10a93-559d-4305-9485-dd93c122c762 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  934.811324] env[76012]: DEBUG oslo_concurrency.lockutils [None req-3ed10a93-559d-4305-9485-dd93c122c762 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  934.820266] env[76012]: DEBUG oslo_concurrency.lockutils [None req-3ed10a93-559d-4305-9485-dd93c122c762 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  934.820529] env[76012]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3ed10a93-559d-4305-9485-dd93c122c762 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  934.820627] env[76012]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3ed10a93-559d-4305-9485-dd93c122c762 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=76012) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  936.823611] env[76012]: CRITICAL neutron [None req-3ed10a93-559d-4305-9485-dd93c122c762 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  936.823611] env[76012]: ERROR neutron Traceback (most recent call last):
[  936.823611] env[76012]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  936.823611] env[76012]: ERROR neutron     sys.exit(main())
[  936.823611] env[76012]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  936.823611] env[76012]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  936.823611] env[76012]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  936.823611] env[76012]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  936.823611] env[76012]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  936.823611] env[76012]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  936.823611] env[76012]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  936.823611] env[76012]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  936.823611] env[76012]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  936.823611] env[76012]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  936.823611] env[76012]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  936.823611] env[76012]: ERROR neutron     response = self.get(path=path, params=params)
[  936.824567] env[76012]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  936.824567] env[76012]: ERROR neutron     raise RuntimeError(msg, last_err)
[  936.824567] env[76012]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  936.824567] env[76012]: ERROR neutron 
[  939.565233] env[76119]: INFO neutron.common.config [-] Logging enabled!
[  939.565655] env[76119]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  939.565783] env[76119]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=76119) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  939.566097] env[76119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  939.566264] env[76119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  939.566988] env[76119]: WARNING oslo_policy.policy [None req-3294e40a-cf9b-46cf-ad21-c38b29d3a198 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  939.567214] env[76119]: WARNING oslo_policy.policy [None req-3294e40a-cf9b-46cf-ad21-c38b29d3a198 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  939.568546] env[76119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-3294e40a-cf9b-46cf-ad21-c38b29d3a198 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  939.583455] env[76119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3294e40a-cf9b-46cf-ad21-c38b29d3a198 None None] Session token - acquiring
[  939.584405] env[76119]: DEBUG networking_nsxv3.common.locking [None req-3294e40a-cf9b-46cf-ad21-c38b29d3a198 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=76119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  939.584647] env[76119]: DEBUG oslo_concurrency.lockutils [None req-3294e40a-cf9b-46cf-ad21-c38b29d3a198 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  939.584776] env[76119]: DEBUG oslo_concurrency.lockutils [None req-3294e40a-cf9b-46cf-ad21-c38b29d3a198 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  939.585156] env[76119]: DEBUG oslo_concurrency.lockutils [None req-3294e40a-cf9b-46cf-ad21-c38b29d3a198 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  939.594517] env[76119]: DEBUG oslo_concurrency.lockutils [None req-3294e40a-cf9b-46cf-ad21-c38b29d3a198 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  939.594767] env[76119]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3294e40a-cf9b-46cf-ad21-c38b29d3a198 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  939.594917] env[76119]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3294e40a-cf9b-46cf-ad21-c38b29d3a198 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=76119) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  941.601118] env[76119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3294e40a-cf9b-46cf-ad21-c38b29d3a198 None None] Session token - acquiring
[  941.601462] env[76119]: DEBUG networking_nsxv3.common.locking [None req-3294e40a-cf9b-46cf-ad21-c38b29d3a198 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=76119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  941.601668] env[76119]: DEBUG oslo_concurrency.lockutils [None req-3294e40a-cf9b-46cf-ad21-c38b29d3a198 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  941.601795] env[76119]: DEBUG oslo_concurrency.lockutils [None req-3294e40a-cf9b-46cf-ad21-c38b29d3a198 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  941.602100] env[76119]: DEBUG oslo_concurrency.lockutils [None req-3294e40a-cf9b-46cf-ad21-c38b29d3a198 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  941.611700] env[76119]: DEBUG oslo_concurrency.lockutils [None req-3294e40a-cf9b-46cf-ad21-c38b29d3a198 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  941.611947] env[76119]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3294e40a-cf9b-46cf-ad21-c38b29d3a198 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  941.612098] env[76119]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3294e40a-cf9b-46cf-ad21-c38b29d3a198 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=76119) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  943.615276] env[76119]: CRITICAL neutron [None req-3294e40a-cf9b-46cf-ad21-c38b29d3a198 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  943.615276] env[76119]: ERROR neutron Traceback (most recent call last):
[  943.615276] env[76119]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  943.615276] env[76119]: ERROR neutron     sys.exit(main())
[  943.615276] env[76119]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  943.615276] env[76119]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  943.615276] env[76119]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  943.615276] env[76119]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  943.615276] env[76119]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  943.615276] env[76119]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  943.615276] env[76119]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  943.615276] env[76119]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  943.615276] env[76119]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  943.615276] env[76119]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  943.615276] env[76119]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  943.615276] env[76119]: ERROR neutron     response = self.get(path=path, params=params)
[  943.616146] env[76119]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  943.616146] env[76119]: ERROR neutron     raise RuntimeError(msg, last_err)
[  943.616146] env[76119]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  943.616146] env[76119]: ERROR neutron 
[  946.290011] env[76342]: INFO neutron.common.config [-] Logging enabled!
[  946.290330] env[76342]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  946.290539] env[76342]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=76342) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  946.290762] env[76342]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  946.290850] env[76342]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  946.291723] env[76342]: WARNING oslo_policy.policy [None req-cf4366e2-9447-481b-943f-cb3b9d6eb1de None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  946.291937] env[76342]: WARNING oslo_policy.policy [None req-cf4366e2-9447-481b-943f-cb3b9d6eb1de None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  946.293209] env[76342]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-cf4366e2-9447-481b-943f-cb3b9d6eb1de None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  946.310879] env[76342]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-cf4366e2-9447-481b-943f-cb3b9d6eb1de None None] Session token - acquiring
[  946.311721] env[76342]: DEBUG networking_nsxv3.common.locking [None req-cf4366e2-9447-481b-943f-cb3b9d6eb1de None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=76342) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  946.311935] env[76342]: DEBUG oslo_concurrency.lockutils [None req-cf4366e2-9447-481b-943f-cb3b9d6eb1de None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  946.312076] env[76342]: DEBUG oslo_concurrency.lockutils [None req-cf4366e2-9447-481b-943f-cb3b9d6eb1de None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  946.312460] env[76342]: DEBUG oslo_concurrency.lockutils [None req-cf4366e2-9447-481b-943f-cb3b9d6eb1de None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  946.324233] env[76342]: DEBUG oslo_concurrency.lockutils [None req-cf4366e2-9447-481b-943f-cb3b9d6eb1de None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  946.324858] env[76342]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-cf4366e2-9447-481b-943f-cb3b9d6eb1de None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  946.325028] env[76342]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-cf4366e2-9447-481b-943f-cb3b9d6eb1de None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=76342) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  948.331367] env[76342]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-cf4366e2-9447-481b-943f-cb3b9d6eb1de None None] Session token - acquiring
[  948.331682] env[76342]: DEBUG networking_nsxv3.common.locking [None req-cf4366e2-9447-481b-943f-cb3b9d6eb1de None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=76342) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  948.331878] env[76342]: DEBUG oslo_concurrency.lockutils [None req-cf4366e2-9447-481b-943f-cb3b9d6eb1de None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  948.332011] env[76342]: DEBUG oslo_concurrency.lockutils [None req-cf4366e2-9447-481b-943f-cb3b9d6eb1de None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  948.332312] env[76342]: DEBUG oslo_concurrency.lockutils [None req-cf4366e2-9447-481b-943f-cb3b9d6eb1de None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  948.341350] env[76342]: DEBUG oslo_concurrency.lockutils [None req-cf4366e2-9447-481b-943f-cb3b9d6eb1de None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  948.341589] env[76342]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-cf4366e2-9447-481b-943f-cb3b9d6eb1de None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  948.341727] env[76342]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-cf4366e2-9447-481b-943f-cb3b9d6eb1de None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=76342) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  950.344643] env[76342]: CRITICAL neutron [None req-cf4366e2-9447-481b-943f-cb3b9d6eb1de None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  950.344643] env[76342]: ERROR neutron Traceback (most recent call last):
[  950.344643] env[76342]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  950.344643] env[76342]: ERROR neutron     sys.exit(main())
[  950.344643] env[76342]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  950.344643] env[76342]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  950.344643] env[76342]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  950.344643] env[76342]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  950.344643] env[76342]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  950.344643] env[76342]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  950.344643] env[76342]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  950.344643] env[76342]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  950.344643] env[76342]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  950.344643] env[76342]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  950.344643] env[76342]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  950.344643] env[76342]: ERROR neutron     response = self.get(path=path, params=params)
[  950.345430] env[76342]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  950.345430] env[76342]: ERROR neutron     raise RuntimeError(msg, last_err)
[  950.345430] env[76342]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  950.345430] env[76342]: ERROR neutron 
[  953.069473] env[76594]: INFO neutron.common.config [-] Logging enabled!
[  953.069770] env[76594]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  953.069998] env[76594]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=76594) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  953.070229] env[76594]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  953.070319] env[76594]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  953.071174] env[76594]: WARNING oslo_policy.policy [None req-1b27a224-953f-4892-9014-f5bcec6ec818 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  953.071393] env[76594]: WARNING oslo_policy.policy [None req-1b27a224-953f-4892-9014-f5bcec6ec818 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  953.072740] env[76594]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-1b27a224-953f-4892-9014-f5bcec6ec818 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  953.087576] env[76594]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-1b27a224-953f-4892-9014-f5bcec6ec818 None None] Session token - acquiring
[  953.091301] env[76594]: DEBUG networking_nsxv3.common.locking [None req-1b27a224-953f-4892-9014-f5bcec6ec818 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=76594) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  953.091301] env[76594]: DEBUG oslo_concurrency.lockutils [None req-1b27a224-953f-4892-9014-f5bcec6ec818 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76594) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  953.091525] env[76594]: DEBUG oslo_concurrency.lockutils [None req-1b27a224-953f-4892-9014-f5bcec6ec818 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76594) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  953.091525] env[76594]: DEBUG oslo_concurrency.lockutils [None req-1b27a224-953f-4892-9014-f5bcec6ec818 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76594) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  953.100898] env[76594]: DEBUG oslo_concurrency.lockutils [None req-1b27a224-953f-4892-9014-f5bcec6ec818 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76594) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  953.102310] env[76594]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-1b27a224-953f-4892-9014-f5bcec6ec818 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  953.102310] env[76594]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-1b27a224-953f-4892-9014-f5bcec6ec818 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=76594) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  955.109227] env[76594]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-1b27a224-953f-4892-9014-f5bcec6ec818 None None] Session token - acquiring
[  955.109486] env[76594]: DEBUG networking_nsxv3.common.locking [None req-1b27a224-953f-4892-9014-f5bcec6ec818 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=76594) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  955.112290] env[76594]: DEBUG oslo_concurrency.lockutils [None req-1b27a224-953f-4892-9014-f5bcec6ec818 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76594) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  955.112290] env[76594]: DEBUG oslo_concurrency.lockutils [None req-1b27a224-953f-4892-9014-f5bcec6ec818 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76594) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  955.112290] env[76594]: DEBUG oslo_concurrency.lockutils [None req-1b27a224-953f-4892-9014-f5bcec6ec818 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76594) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  955.121266] env[76594]: DEBUG oslo_concurrency.lockutils [None req-1b27a224-953f-4892-9014-f5bcec6ec818 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76594) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  955.121681] env[76594]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-1b27a224-953f-4892-9014-f5bcec6ec818 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  955.121927] env[76594]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-1b27a224-953f-4892-9014-f5bcec6ec818 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=76594) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  957.131512] env[76594]: CRITICAL neutron [None req-1b27a224-953f-4892-9014-f5bcec6ec818 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  957.131512] env[76594]: ERROR neutron Traceback (most recent call last):
[  957.131512] env[76594]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  957.131512] env[76594]: ERROR neutron     sys.exit(main())
[  957.131512] env[76594]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  957.131512] env[76594]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  957.131512] env[76594]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  957.131512] env[76594]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  957.131512] env[76594]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  957.131512] env[76594]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  957.131512] env[76594]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  957.131512] env[76594]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  957.131512] env[76594]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  957.131512] env[76594]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  957.131512] env[76594]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  957.131512] env[76594]: ERROR neutron     response = self.get(path=path, params=params)
[  957.132411] env[76594]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  957.132411] env[76594]: ERROR neutron     raise RuntimeError(msg, last_err)
[  957.132411] env[76594]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  957.132411] env[76594]: ERROR neutron 
[  959.779612] env[76944]: INFO neutron.common.config [-] Logging enabled!
[  959.779998] env[76944]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  959.780212] env[76944]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=76944) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  959.780463] env[76944]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  959.780560] env[76944]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  959.781404] env[76944]: WARNING oslo_policy.policy [None req-1cb876c0-0a07-403f-8605-e018aa927e96 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  959.781631] env[76944]: WARNING oslo_policy.policy [None req-1cb876c0-0a07-403f-8605-e018aa927e96 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  959.782882] env[76944]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-1cb876c0-0a07-403f-8605-e018aa927e96 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  959.798098] env[76944]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-1cb876c0-0a07-403f-8605-e018aa927e96 None None] Session token - acquiring
[  959.798890] env[76944]: DEBUG networking_nsxv3.common.locking [None req-1cb876c0-0a07-403f-8605-e018aa927e96 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=76944) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  959.799187] env[76944]: DEBUG oslo_concurrency.lockutils [None req-1cb876c0-0a07-403f-8605-e018aa927e96 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76944) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  959.799318] env[76944]: DEBUG oslo_concurrency.lockutils [None req-1cb876c0-0a07-403f-8605-e018aa927e96 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76944) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  959.799683] env[76944]: DEBUG oslo_concurrency.lockutils [None req-1cb876c0-0a07-403f-8605-e018aa927e96 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76944) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  959.810271] env[76944]: DEBUG oslo_concurrency.lockutils [None req-1cb876c0-0a07-403f-8605-e018aa927e96 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76944) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  959.810520] env[76944]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-1cb876c0-0a07-403f-8605-e018aa927e96 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  959.810673] env[76944]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-1cb876c0-0a07-403f-8605-e018aa927e96 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=76944) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  961.817279] env[76944]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-1cb876c0-0a07-403f-8605-e018aa927e96 None None] Session token - acquiring
[  961.817279] env[76944]: DEBUG networking_nsxv3.common.locking [None req-1cb876c0-0a07-403f-8605-e018aa927e96 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=76944) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  961.817571] env[76944]: DEBUG oslo_concurrency.lockutils [None req-1cb876c0-0a07-403f-8605-e018aa927e96 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76944) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  961.817571] env[76944]: DEBUG oslo_concurrency.lockutils [None req-1cb876c0-0a07-403f-8605-e018aa927e96 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76944) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  961.817849] env[76944]: DEBUG oslo_concurrency.lockutils [None req-1cb876c0-0a07-403f-8605-e018aa927e96 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76944) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  961.826979] env[76944]: DEBUG oslo_concurrency.lockutils [None req-1cb876c0-0a07-403f-8605-e018aa927e96 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=76944) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  961.827228] env[76944]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-1cb876c0-0a07-403f-8605-e018aa927e96 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  961.827366] env[76944]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-1cb876c0-0a07-403f-8605-e018aa927e96 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=76944) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  963.829524] env[76944]: CRITICAL neutron [None req-1cb876c0-0a07-403f-8605-e018aa927e96 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  963.829524] env[76944]: ERROR neutron Traceback (most recent call last):
[  963.829524] env[76944]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  963.829524] env[76944]: ERROR neutron     sys.exit(main())
[  963.829524] env[76944]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  963.829524] env[76944]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  963.829524] env[76944]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  963.829524] env[76944]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  963.829524] env[76944]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  963.829524] env[76944]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  963.829524] env[76944]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  963.829524] env[76944]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  963.829524] env[76944]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  963.829524] env[76944]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  963.829524] env[76944]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  963.829524] env[76944]: ERROR neutron     response = self.get(path=path, params=params)
[  963.830300] env[76944]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  963.830300] env[76944]: ERROR neutron     raise RuntimeError(msg, last_err)
[  963.830300] env[76944]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  963.830300] env[76944]: ERROR neutron 
[  966.476290] env[77078]: INFO neutron.common.config [-] Logging enabled!
[  966.476617] env[77078]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  966.476892] env[77078]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=77078) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  966.477130] env[77078]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  966.477222] env[77078]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  966.478176] env[77078]: WARNING oslo_policy.policy [None req-1d582a8d-b41e-4c8e-88c9-7c68a53c60cc None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  966.478369] env[77078]: WARNING oslo_policy.policy [None req-1d582a8d-b41e-4c8e-88c9-7c68a53c60cc None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  966.479799] env[77078]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-1d582a8d-b41e-4c8e-88c9-7c68a53c60cc None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  966.494351] env[77078]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-1d582a8d-b41e-4c8e-88c9-7c68a53c60cc None None] Session token - acquiring
[  966.495150] env[77078]: DEBUG networking_nsxv3.common.locking [None req-1d582a8d-b41e-4c8e-88c9-7c68a53c60cc None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=77078) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  966.495358] env[77078]: DEBUG oslo_concurrency.lockutils [None req-1d582a8d-b41e-4c8e-88c9-7c68a53c60cc None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  966.495484] env[77078]: DEBUG oslo_concurrency.lockutils [None req-1d582a8d-b41e-4c8e-88c9-7c68a53c60cc None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  966.495868] env[77078]: DEBUG oslo_concurrency.lockutils [None req-1d582a8d-b41e-4c8e-88c9-7c68a53c60cc None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  966.505123] env[77078]: DEBUG oslo_concurrency.lockutils [None req-1d582a8d-b41e-4c8e-88c9-7c68a53c60cc None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  966.505377] env[77078]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-1d582a8d-b41e-4c8e-88c9-7c68a53c60cc None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  966.505528] env[77078]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-1d582a8d-b41e-4c8e-88c9-7c68a53c60cc None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=77078) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  968.511825] env[77078]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-1d582a8d-b41e-4c8e-88c9-7c68a53c60cc None None] Session token - acquiring
[  968.512204] env[77078]: DEBUG networking_nsxv3.common.locking [None req-1d582a8d-b41e-4c8e-88c9-7c68a53c60cc None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=77078) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  968.512413] env[77078]: DEBUG oslo_concurrency.lockutils [None req-1d582a8d-b41e-4c8e-88c9-7c68a53c60cc None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  968.512533] env[77078]: DEBUG oslo_concurrency.lockutils [None req-1d582a8d-b41e-4c8e-88c9-7c68a53c60cc None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  968.512835] env[77078]: DEBUG oslo_concurrency.lockutils [None req-1d582a8d-b41e-4c8e-88c9-7c68a53c60cc None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  968.521837] env[77078]: DEBUG oslo_concurrency.lockutils [None req-1d582a8d-b41e-4c8e-88c9-7c68a53c60cc None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  968.522092] env[77078]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-1d582a8d-b41e-4c8e-88c9-7c68a53c60cc None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  968.522234] env[77078]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-1d582a8d-b41e-4c8e-88c9-7c68a53c60cc None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=77078) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  970.526855] env[77078]: CRITICAL neutron [None req-1d582a8d-b41e-4c8e-88c9-7c68a53c60cc None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  970.526855] env[77078]: ERROR neutron Traceback (most recent call last):
[  970.526855] env[77078]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  970.526855] env[77078]: ERROR neutron     sys.exit(main())
[  970.526855] env[77078]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  970.526855] env[77078]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  970.526855] env[77078]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  970.526855] env[77078]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  970.526855] env[77078]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  970.526855] env[77078]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  970.526855] env[77078]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  970.526855] env[77078]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  970.526855] env[77078]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  970.526855] env[77078]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  970.526855] env[77078]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  970.526855] env[77078]: ERROR neutron     response = self.get(path=path, params=params)
[  970.527680] env[77078]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  970.527680] env[77078]: ERROR neutron     raise RuntimeError(msg, last_err)
[  970.527680] env[77078]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  970.527680] env[77078]: ERROR neutron 
[  973.060070] env[77197]: INFO neutron.common.config [-] Logging enabled!
[  973.060387] env[77197]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  973.060617] env[77197]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=77197) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  973.060839] env[77197]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  973.060939] env[77197]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  973.061769] env[77197]: WARNING oslo_policy.policy [None req-698d18e0-c6a5-44bd-afce-5943d0fdfc8a None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  973.062013] env[77197]: WARNING oslo_policy.policy [None req-698d18e0-c6a5-44bd-afce-5943d0fdfc8a None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  973.063178] env[77197]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-698d18e0-c6a5-44bd-afce-5943d0fdfc8a None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  973.076512] env[77197]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-698d18e0-c6a5-44bd-afce-5943d0fdfc8a None None] Session token - acquiring
[  973.077251] env[77197]: DEBUG networking_nsxv3.common.locking [None req-698d18e0-c6a5-44bd-afce-5943d0fdfc8a None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=77197) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  973.077461] env[77197]: DEBUG oslo_concurrency.lockutils [None req-698d18e0-c6a5-44bd-afce-5943d0fdfc8a None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77197) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  973.077587] env[77197]: DEBUG oslo_concurrency.lockutils [None req-698d18e0-c6a5-44bd-afce-5943d0fdfc8a None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77197) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  973.077958] env[77197]: DEBUG oslo_concurrency.lockutils [None req-698d18e0-c6a5-44bd-afce-5943d0fdfc8a None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77197) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  973.098151] env[77197]: DEBUG oslo_concurrency.lockutils [None req-698d18e0-c6a5-44bd-afce-5943d0fdfc8a None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77197) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  973.098421] env[77197]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-698d18e0-c6a5-44bd-afce-5943d0fdfc8a None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  973.098571] env[77197]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-698d18e0-c6a5-44bd-afce-5943d0fdfc8a None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=77197) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  975.105064] env[77197]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-698d18e0-c6a5-44bd-afce-5943d0fdfc8a None None] Session token - acquiring
[  975.105511] env[77197]: DEBUG networking_nsxv3.common.locking [None req-698d18e0-c6a5-44bd-afce-5943d0fdfc8a None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=77197) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  975.105711] env[77197]: DEBUG oslo_concurrency.lockutils [None req-698d18e0-c6a5-44bd-afce-5943d0fdfc8a None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77197) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  975.105836] env[77197]: DEBUG oslo_concurrency.lockutils [None req-698d18e0-c6a5-44bd-afce-5943d0fdfc8a None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77197) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  975.106109] env[77197]: DEBUG oslo_concurrency.lockutils [None req-698d18e0-c6a5-44bd-afce-5943d0fdfc8a None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77197) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  975.115083] env[77197]: DEBUG oslo_concurrency.lockutils [None req-698d18e0-c6a5-44bd-afce-5943d0fdfc8a None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77197) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  975.115320] env[77197]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-698d18e0-c6a5-44bd-afce-5943d0fdfc8a None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  975.115457] env[77197]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-698d18e0-c6a5-44bd-afce-5943d0fdfc8a None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=77197) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  977.116992] env[77197]: CRITICAL neutron [None req-698d18e0-c6a5-44bd-afce-5943d0fdfc8a None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  977.116992] env[77197]: ERROR neutron Traceback (most recent call last):
[  977.116992] env[77197]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  977.116992] env[77197]: ERROR neutron     sys.exit(main())
[  977.116992] env[77197]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  977.116992] env[77197]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  977.116992] env[77197]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  977.116992] env[77197]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  977.116992] env[77197]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  977.116992] env[77197]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  977.116992] env[77197]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  977.116992] env[77197]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  977.116992] env[77197]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  977.116992] env[77197]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  977.116992] env[77197]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  977.116992] env[77197]: ERROR neutron     response = self.get(path=path, params=params)
[  977.117822] env[77197]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  977.117822] env[77197]: ERROR neutron     raise RuntimeError(msg, last_err)
[  977.117822] env[77197]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  977.117822] env[77197]: ERROR neutron 
[  979.783922] env[77337]: INFO neutron.common.config [-] Logging enabled!
[  979.784251] env[77337]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  979.784467] env[77337]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=77337) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  979.784688] env[77337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  979.784781] env[77337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  979.785604] env[77337]: WARNING oslo_policy.policy [None req-fadc3a7a-8389-4300-b2ae-e1f7fef69cf9 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  979.785824] env[77337]: WARNING oslo_policy.policy [None req-fadc3a7a-8389-4300-b2ae-e1f7fef69cf9 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  979.786994] env[77337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-fadc3a7a-8389-4300-b2ae-e1f7fef69cf9 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  979.801354] env[77337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-fadc3a7a-8389-4300-b2ae-e1f7fef69cf9 None None] Session token - acquiring
[  979.802132] env[77337]: DEBUG networking_nsxv3.common.locking [None req-fadc3a7a-8389-4300-b2ae-e1f7fef69cf9 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=77337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  979.802334] env[77337]: DEBUG oslo_concurrency.lockutils [None req-fadc3a7a-8389-4300-b2ae-e1f7fef69cf9 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  979.802460] env[77337]: DEBUG oslo_concurrency.lockutils [None req-fadc3a7a-8389-4300-b2ae-e1f7fef69cf9 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  979.802811] env[77337]: DEBUG oslo_concurrency.lockutils [None req-fadc3a7a-8389-4300-b2ae-e1f7fef69cf9 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  979.812209] env[77337]: DEBUG oslo_concurrency.lockutils [None req-fadc3a7a-8389-4300-b2ae-e1f7fef69cf9 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  979.812462] env[77337]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-fadc3a7a-8389-4300-b2ae-e1f7fef69cf9 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  979.812596] env[77337]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-fadc3a7a-8389-4300-b2ae-e1f7fef69cf9 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=77337) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  981.818625] env[77337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-fadc3a7a-8389-4300-b2ae-e1f7fef69cf9 None None] Session token - acquiring
[  981.818894] env[77337]: DEBUG networking_nsxv3.common.locking [None req-fadc3a7a-8389-4300-b2ae-e1f7fef69cf9 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=77337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  981.819129] env[77337]: DEBUG oslo_concurrency.lockutils [None req-fadc3a7a-8389-4300-b2ae-e1f7fef69cf9 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  981.819264] env[77337]: DEBUG oslo_concurrency.lockutils [None req-fadc3a7a-8389-4300-b2ae-e1f7fef69cf9 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  981.819538] env[77337]: DEBUG oslo_concurrency.lockutils [None req-fadc3a7a-8389-4300-b2ae-e1f7fef69cf9 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  981.828654] env[77337]: DEBUG oslo_concurrency.lockutils [None req-fadc3a7a-8389-4300-b2ae-e1f7fef69cf9 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  981.829606] env[77337]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-fadc3a7a-8389-4300-b2ae-e1f7fef69cf9 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  981.829606] env[77337]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-fadc3a7a-8389-4300-b2ae-e1f7fef69cf9 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=77337) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  983.835595] env[77337]: CRITICAL neutron [None req-fadc3a7a-8389-4300-b2ae-e1f7fef69cf9 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  983.835595] env[77337]: ERROR neutron Traceback (most recent call last):
[  983.835595] env[77337]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  983.835595] env[77337]: ERROR neutron     sys.exit(main())
[  983.835595] env[77337]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  983.835595] env[77337]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  983.835595] env[77337]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  983.835595] env[77337]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  983.835595] env[77337]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  983.835595] env[77337]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  983.835595] env[77337]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  983.835595] env[77337]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  983.835595] env[77337]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  983.835595] env[77337]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  983.835595] env[77337]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  983.835595] env[77337]: ERROR neutron     response = self.get(path=path, params=params)
[  983.836317] env[77337]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  983.836317] env[77337]: ERROR neutron     raise RuntimeError(msg, last_err)
[  983.836317] env[77337]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  983.836317] env[77337]: ERROR neutron 
[  986.539022] env[77457]: INFO neutron.common.config [-] Logging enabled!
[  986.539289] env[77457]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  986.539586] env[77457]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=77457) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  986.539813] env[77457]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  986.540375] env[77457]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  986.541314] env[77457]: WARNING oslo_policy.policy [None req-344e8911-c443-422e-975b-28340f0308bf None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  986.541314] env[77457]: WARNING oslo_policy.policy [None req-344e8911-c443-422e-975b-28340f0308bf None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  986.542218] env[77457]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-344e8911-c443-422e-975b-28340f0308bf None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  986.556133] env[77457]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-344e8911-c443-422e-975b-28340f0308bf None None] Session token - acquiring
[  986.556897] env[77457]: DEBUG networking_nsxv3.common.locking [None req-344e8911-c443-422e-975b-28340f0308bf None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=77457) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  986.557139] env[77457]: DEBUG oslo_concurrency.lockutils [None req-344e8911-c443-422e-975b-28340f0308bf None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77457) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  986.557288] env[77457]: DEBUG oslo_concurrency.lockutils [None req-344e8911-c443-422e-975b-28340f0308bf None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77457) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  986.557654] env[77457]: DEBUG oslo_concurrency.lockutils [None req-344e8911-c443-422e-975b-28340f0308bf None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77457) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  986.566533] env[77457]: DEBUG oslo_concurrency.lockutils [None req-344e8911-c443-422e-975b-28340f0308bf None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77457) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  986.566801] env[77457]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-344e8911-c443-422e-975b-28340f0308bf None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  986.566957] env[77457]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-344e8911-c443-422e-975b-28340f0308bf None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=77457) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  988.573310] env[77457]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-344e8911-c443-422e-975b-28340f0308bf None None] Session token - acquiring
[  988.573774] env[77457]: DEBUG networking_nsxv3.common.locking [None req-344e8911-c443-422e-975b-28340f0308bf None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=77457) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  988.573921] env[77457]: DEBUG oslo_concurrency.lockutils [None req-344e8911-c443-422e-975b-28340f0308bf None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77457) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  988.574048] env[77457]: DEBUG oslo_concurrency.lockutils [None req-344e8911-c443-422e-975b-28340f0308bf None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77457) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  988.574329] env[77457]: DEBUG oslo_concurrency.lockutils [None req-344e8911-c443-422e-975b-28340f0308bf None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77457) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  988.583023] env[77457]: DEBUG oslo_concurrency.lockutils [None req-344e8911-c443-422e-975b-28340f0308bf None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77457) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  988.583254] env[77457]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-344e8911-c443-422e-975b-28340f0308bf None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  988.583394] env[77457]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-344e8911-c443-422e-975b-28340f0308bf None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=77457) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  990.584947] env[77457]: CRITICAL neutron [None req-344e8911-c443-422e-975b-28340f0308bf None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  990.584947] env[77457]: ERROR neutron Traceback (most recent call last):
[  990.584947] env[77457]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  990.584947] env[77457]: ERROR neutron     sys.exit(main())
[  990.584947] env[77457]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  990.584947] env[77457]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  990.584947] env[77457]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  990.584947] env[77457]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  990.584947] env[77457]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  990.584947] env[77457]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  990.584947] env[77457]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  990.584947] env[77457]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  990.584947] env[77457]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  990.584947] env[77457]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  990.584947] env[77457]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  990.584947] env[77457]: ERROR neutron     response = self.get(path=path, params=params)
[  990.586113] env[77457]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  990.586113] env[77457]: ERROR neutron     raise RuntimeError(msg, last_err)
[  990.586113] env[77457]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  990.586113] env[77457]: ERROR neutron 
[  993.259568] env[77492]: INFO neutron.common.config [-] Logging enabled!
[  993.259867] env[77492]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  993.260216] env[77492]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=77492) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  993.260471] env[77492]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  993.260563] env[77492]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  993.261416] env[77492]: WARNING oslo_policy.policy [None req-4aab387a-6ac0-4e91-86f3-3b3e7f98895c None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  993.261630] env[77492]: WARNING oslo_policy.policy [None req-4aab387a-6ac0-4e91-86f3-3b3e7f98895c None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  993.262865] env[77492]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-4aab387a-6ac0-4e91-86f3-3b3e7f98895c None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  993.277119] env[77492]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-4aab387a-6ac0-4e91-86f3-3b3e7f98895c None None] Session token - acquiring
[  993.277909] env[77492]: DEBUG networking_nsxv3.common.locking [None req-4aab387a-6ac0-4e91-86f3-3b3e7f98895c None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=77492) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  993.278172] env[77492]: DEBUG oslo_concurrency.lockutils [None req-4aab387a-6ac0-4e91-86f3-3b3e7f98895c None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77492) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  993.278297] env[77492]: DEBUG oslo_concurrency.lockutils [None req-4aab387a-6ac0-4e91-86f3-3b3e7f98895c None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77492) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  993.278663] env[77492]: DEBUG oslo_concurrency.lockutils [None req-4aab387a-6ac0-4e91-86f3-3b3e7f98895c None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77492) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  993.287869] env[77492]: DEBUG oslo_concurrency.lockutils [None req-4aab387a-6ac0-4e91-86f3-3b3e7f98895c None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77492) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  993.288176] env[77492]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-4aab387a-6ac0-4e91-86f3-3b3e7f98895c None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  993.288332] env[77492]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-4aab387a-6ac0-4e91-86f3-3b3e7f98895c None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=77492) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  995.294424] env[77492]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-4aab387a-6ac0-4e91-86f3-3b3e7f98895c None None] Session token - acquiring
[  995.294863] env[77492]: DEBUG networking_nsxv3.common.locking [None req-4aab387a-6ac0-4e91-86f3-3b3e7f98895c None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=77492) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  995.295048] env[77492]: DEBUG oslo_concurrency.lockutils [None req-4aab387a-6ac0-4e91-86f3-3b3e7f98895c None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77492) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  995.295168] env[77492]: DEBUG oslo_concurrency.lockutils [None req-4aab387a-6ac0-4e91-86f3-3b3e7f98895c None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77492) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  995.295448] env[77492]: DEBUG oslo_concurrency.lockutils [None req-4aab387a-6ac0-4e91-86f3-3b3e7f98895c None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77492) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  995.304637] env[77492]: DEBUG oslo_concurrency.lockutils [None req-4aab387a-6ac0-4e91-86f3-3b3e7f98895c None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77492) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  995.304932] env[77492]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-4aab387a-6ac0-4e91-86f3-3b3e7f98895c None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  995.305013] env[77492]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-4aab387a-6ac0-4e91-86f3-3b3e7f98895c None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=77492) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[  997.308098] env[77492]: CRITICAL neutron [None req-4aab387a-6ac0-4e91-86f3-3b3e7f98895c None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  997.308098] env[77492]: ERROR neutron Traceback (most recent call last):
[  997.308098] env[77492]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[  997.308098] env[77492]: ERROR neutron     sys.exit(main())
[  997.308098] env[77492]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[  997.308098] env[77492]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[  997.308098] env[77492]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[  997.308098] env[77492]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[  997.308098] env[77492]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[  997.308098] env[77492]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[  997.308098] env[77492]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[  997.308098] env[77492]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[  997.308098] env[77492]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[  997.308098] env[77492]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[  997.308098] env[77492]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[  997.308098] env[77492]: ERROR neutron     response = self.get(path=path, params=params)
[  997.308944] env[77492]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[  997.308944] env[77492]: ERROR neutron     raise RuntimeError(msg, last_err)
[  997.308944] env[77492]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[  997.308944] env[77492]: ERROR neutron 
[  999.939644] env[77592]: INFO neutron.common.config [-] Logging enabled!
[  999.939919] env[77592]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[  999.940226] env[77592]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=77592) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[  999.940448] env[77592]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[  999.940538] env[77592]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[  999.941361] env[77592]: WARNING oslo_policy.policy [None req-01d9c79a-e012-45ca-bab6-c82dfad394c7 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  999.941582] env[77592]: WARNING oslo_policy.policy [None req-01d9c79a-e012-45ca-bab6-c82dfad394c7 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[  999.942752] env[77592]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-01d9c79a-e012-45ca-bab6-c82dfad394c7 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[  999.957121] env[77592]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-01d9c79a-e012-45ca-bab6-c82dfad394c7 None None] Session token - acquiring
[  999.957951] env[77592]: DEBUG networking_nsxv3.common.locking [None req-01d9c79a-e012-45ca-bab6-c82dfad394c7 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=77592) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[  999.958163] env[77592]: DEBUG oslo_concurrency.lockutils [None req-01d9c79a-e012-45ca-bab6-c82dfad394c7 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77592) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[  999.958293] env[77592]: DEBUG oslo_concurrency.lockutils [None req-01d9c79a-e012-45ca-bab6-c82dfad394c7 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77592) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[  999.958651] env[77592]: DEBUG oslo_concurrency.lockutils [None req-01d9c79a-e012-45ca-bab6-c82dfad394c7 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77592) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[  999.969635] env[77592]: DEBUG oslo_concurrency.lockutils [None req-01d9c79a-e012-45ca-bab6-c82dfad394c7 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77592) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[  999.969979] env[77592]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-01d9c79a-e012-45ca-bab6-c82dfad394c7 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[  999.970177] env[77592]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-01d9c79a-e012-45ca-bab6-c82dfad394c7 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=77592) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[ 1001.976347] env[77592]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-01d9c79a-e012-45ca-bab6-c82dfad394c7 None None] Session token - acquiring
[ 1001.976748] env[77592]: DEBUG networking_nsxv3.common.locking [None req-01d9c79a-e012-45ca-bab6-c82dfad394c7 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=77592) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[ 1001.976863] env[77592]: DEBUG oslo_concurrency.lockutils [None req-01d9c79a-e012-45ca-bab6-c82dfad394c7 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77592) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[ 1001.976963] env[77592]: DEBUG oslo_concurrency.lockutils [None req-01d9c79a-e012-45ca-bab6-c82dfad394c7 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77592) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[ 1001.977290] env[77592]: DEBUG oslo_concurrency.lockutils [None req-01d9c79a-e012-45ca-bab6-c82dfad394c7 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77592) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[ 1001.986289] env[77592]: DEBUG oslo_concurrency.lockutils [None req-01d9c79a-e012-45ca-bab6-c82dfad394c7 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77592) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[ 1001.986524] env[77592]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-01d9c79a-e012-45ca-bab6-c82dfad394c7 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[ 1001.986667] env[77592]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-01d9c79a-e012-45ca-bab6-c82dfad394c7 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=77592) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[ 1003.989656] env[77592]: CRITICAL neutron [None req-01d9c79a-e012-45ca-bab6-c82dfad394c7 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[ 1003.989656] env[77592]: ERROR neutron Traceback (most recent call last):
[ 1003.989656] env[77592]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[ 1003.989656] env[77592]: ERROR neutron     sys.exit(main())
[ 1003.989656] env[77592]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[ 1003.989656] env[77592]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[ 1003.989656] env[77592]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[ 1003.989656] env[77592]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[ 1003.989656] env[77592]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[ 1003.989656] env[77592]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[ 1003.989656] env[77592]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[ 1003.989656] env[77592]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[ 1003.989656] env[77592]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[ 1003.989656] env[77592]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[ 1003.989656] env[77592]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[ 1003.989656] env[77592]: ERROR neutron     response = self.get(path=path, params=params)
[ 1003.990590] env[77592]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[ 1003.990590] env[77592]: ERROR neutron     raise RuntimeError(msg, last_err)
[ 1003.990590] env[77592]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[ 1003.990590] env[77592]: ERROR neutron 
[ 1006.459281] env[77608]: INFO neutron.common.config [-] Logging enabled!
[ 1006.459686] env[77608]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[ 1006.459775] env[77608]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=77608) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[ 1006.459999] env[77608]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[ 1006.460103] env[77608]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[ 1006.460916] env[77608]: WARNING oslo_policy.policy [None req-664a18a1-bced-4330-96d0-f9b10129b0fa None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[ 1006.461144] env[77608]: WARNING oslo_policy.policy [None req-664a18a1-bced-4330-96d0-f9b10129b0fa None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[ 1006.462310] env[77608]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-664a18a1-bced-4330-96d0-f9b10129b0fa None None] Looking for TransportZone with name nsx-vlan-transportzone.
[ 1006.481292] env[77608]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-664a18a1-bced-4330-96d0-f9b10129b0fa None None] Session token - acquiring
[ 1006.482077] env[77608]: DEBUG networking_nsxv3.common.locking [None req-664a18a1-bced-4330-96d0-f9b10129b0fa None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=77608) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[ 1006.482259] env[77608]: DEBUG oslo_concurrency.lockutils [None req-664a18a1-bced-4330-96d0-f9b10129b0fa None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77608) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[ 1006.482389] env[77608]: DEBUG oslo_concurrency.lockutils [None req-664a18a1-bced-4330-96d0-f9b10129b0fa None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77608) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[ 1006.482742] env[77608]: DEBUG oslo_concurrency.lockutils [None req-664a18a1-bced-4330-96d0-f9b10129b0fa None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77608) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[ 1006.492176] env[77608]: DEBUG oslo_concurrency.lockutils [None req-664a18a1-bced-4330-96d0-f9b10129b0fa None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77608) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[ 1006.492421] env[77608]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-664a18a1-bced-4330-96d0-f9b10129b0fa None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[ 1006.492574] env[77608]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-664a18a1-bced-4330-96d0-f9b10129b0fa None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=77608) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[ 1008.499916] env[77608]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-664a18a1-bced-4330-96d0-f9b10129b0fa None None] Session token - acquiring
[ 1008.499916] env[77608]: DEBUG networking_nsxv3.common.locking [None req-664a18a1-bced-4330-96d0-f9b10129b0fa None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=77608) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[ 1008.499916] env[77608]: DEBUG oslo_concurrency.lockutils [None req-664a18a1-bced-4330-96d0-f9b10129b0fa None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77608) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[ 1008.500370] env[77608]: DEBUG oslo_concurrency.lockutils [None req-664a18a1-bced-4330-96d0-f9b10129b0fa None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77608) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[ 1008.500370] env[77608]: DEBUG oslo_concurrency.lockutils [None req-664a18a1-bced-4330-96d0-f9b10129b0fa None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77608) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[ 1008.509085] env[77608]: DEBUG oslo_concurrency.lockutils [None req-664a18a1-bced-4330-96d0-f9b10129b0fa None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77608) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[ 1008.509345] env[77608]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-664a18a1-bced-4330-96d0-f9b10129b0fa None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[ 1008.509485] env[77608]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-664a18a1-bced-4330-96d0-f9b10129b0fa None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=77608) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[ 1010.512577] env[77608]: CRITICAL neutron [None req-664a18a1-bced-4330-96d0-f9b10129b0fa None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[ 1010.512577] env[77608]: ERROR neutron Traceback (most recent call last):
[ 1010.512577] env[77608]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[ 1010.512577] env[77608]: ERROR neutron     sys.exit(main())
[ 1010.512577] env[77608]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[ 1010.512577] env[77608]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[ 1010.512577] env[77608]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[ 1010.512577] env[77608]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[ 1010.512577] env[77608]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[ 1010.512577] env[77608]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[ 1010.512577] env[77608]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[ 1010.512577] env[77608]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[ 1010.512577] env[77608]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[ 1010.512577] env[77608]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[ 1010.512577] env[77608]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[ 1010.512577] env[77608]: ERROR neutron     response = self.get(path=path, params=params)
[ 1010.513430] env[77608]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[ 1010.513430] env[77608]: ERROR neutron     raise RuntimeError(msg, last_err)
[ 1010.513430] env[77608]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[ 1010.513430] env[77608]: ERROR neutron 
[ 1012.959126] env[77656]: INFO neutron.common.config [-] Logging enabled!
[ 1012.959659] env[77656]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[ 1012.959659] env[77656]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=77656) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[ 1012.959891] env[77656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[ 1012.959982] env[77656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[ 1012.960894] env[77656]: WARNING oslo_policy.policy [None req-79fffc33-b05d-4a45-b45f-7630329ad6bd None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[ 1012.961153] env[77656]: WARNING oslo_policy.policy [None req-79fffc33-b05d-4a45-b45f-7630329ad6bd None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[ 1012.962447] env[77656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-79fffc33-b05d-4a45-b45f-7630329ad6bd None None] Looking for TransportZone with name nsx-vlan-transportzone.
[ 1012.977010] env[77656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-79fffc33-b05d-4a45-b45f-7630329ad6bd None None] Session token - acquiring
[ 1012.977810] env[77656]: DEBUG networking_nsxv3.common.locking [None req-79fffc33-b05d-4a45-b45f-7630329ad6bd None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=77656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[ 1012.978051] env[77656]: DEBUG oslo_concurrency.lockutils [None req-79fffc33-b05d-4a45-b45f-7630329ad6bd None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[ 1012.978190] env[77656]: DEBUG oslo_concurrency.lockutils [None req-79fffc33-b05d-4a45-b45f-7630329ad6bd None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[ 1012.978583] env[77656]: DEBUG oslo_concurrency.lockutils [None req-79fffc33-b05d-4a45-b45f-7630329ad6bd None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[ 1012.987651] env[77656]: DEBUG oslo_concurrency.lockutils [None req-79fffc33-b05d-4a45-b45f-7630329ad6bd None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[ 1012.987918] env[77656]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-79fffc33-b05d-4a45-b45f-7630329ad6bd None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[ 1012.988121] env[77656]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-79fffc33-b05d-4a45-b45f-7630329ad6bd None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=77656) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[ 1014.994222] env[77656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-79fffc33-b05d-4a45-b45f-7630329ad6bd None None] Session token - acquiring
[ 1014.994746] env[77656]: DEBUG networking_nsxv3.common.locking [None req-79fffc33-b05d-4a45-b45f-7630329ad6bd None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=77656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[ 1014.994989] env[77656]: DEBUG oslo_concurrency.lockutils [None req-79fffc33-b05d-4a45-b45f-7630329ad6bd None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[ 1014.995154] env[77656]: DEBUG oslo_concurrency.lockutils [None req-79fffc33-b05d-4a45-b45f-7630329ad6bd None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[ 1014.995467] env[77656]: DEBUG oslo_concurrency.lockutils [None req-79fffc33-b05d-4a45-b45f-7630329ad6bd None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[ 1015.004867] env[77656]: DEBUG oslo_concurrency.lockutils [None req-79fffc33-b05d-4a45-b45f-7630329ad6bd None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[ 1015.005139] env[77656]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-79fffc33-b05d-4a45-b45f-7630329ad6bd None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[ 1015.005317] env[77656]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-79fffc33-b05d-4a45-b45f-7630329ad6bd None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=77656) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[ 1017.008321] env[77656]: CRITICAL neutron [None req-79fffc33-b05d-4a45-b45f-7630329ad6bd None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[ 1017.008321] env[77656]: ERROR neutron Traceback (most recent call last):
[ 1017.008321] env[77656]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[ 1017.008321] env[77656]: ERROR neutron     sys.exit(main())
[ 1017.008321] env[77656]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[ 1017.008321] env[77656]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[ 1017.008321] env[77656]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[ 1017.008321] env[77656]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[ 1017.008321] env[77656]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[ 1017.008321] env[77656]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[ 1017.008321] env[77656]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[ 1017.008321] env[77656]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[ 1017.008321] env[77656]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[ 1017.008321] env[77656]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[ 1017.008321] env[77656]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[ 1017.008321] env[77656]: ERROR neutron     response = self.get(path=path, params=params)
[ 1017.009747] env[77656]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[ 1017.009747] env[77656]: ERROR neutron     raise RuntimeError(msg, last_err)
[ 1017.009747] env[77656]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[ 1017.009747] env[77656]: ERROR neutron 
[ 1019.458203] env[77661]: INFO neutron.common.config [-] Logging enabled!
[ 1019.458588] env[77661]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[ 1019.458704] env[77661]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=77661) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[ 1019.458939] env[77661]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[ 1019.459033] env[77661]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[ 1019.459847] env[77661]: WARNING oslo_policy.policy [None req-8fcd1743-4089-46c0-8fe9-ff88d7258e7e None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[ 1019.460107] env[77661]: WARNING oslo_policy.policy [None req-8fcd1743-4089-46c0-8fe9-ff88d7258e7e None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[ 1019.461298] env[77661]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-8fcd1743-4089-46c0-8fe9-ff88d7258e7e None None] Looking for TransportZone with name nsx-vlan-transportzone.
[ 1019.475538] env[77661]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-8fcd1743-4089-46c0-8fe9-ff88d7258e7e None None] Session token - acquiring
[ 1019.476322] env[77661]: DEBUG networking_nsxv3.common.locking [None req-8fcd1743-4089-46c0-8fe9-ff88d7258e7e None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=77661) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[ 1019.476532] env[77661]: DEBUG oslo_concurrency.lockutils [None req-8fcd1743-4089-46c0-8fe9-ff88d7258e7e None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77661) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[ 1019.476657] env[77661]: DEBUG oslo_concurrency.lockutils [None req-8fcd1743-4089-46c0-8fe9-ff88d7258e7e None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77661) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[ 1019.477012] env[77661]: DEBUG oslo_concurrency.lockutils [None req-8fcd1743-4089-46c0-8fe9-ff88d7258e7e None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77661) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[ 1019.486297] env[77661]: DEBUG oslo_concurrency.lockutils [None req-8fcd1743-4089-46c0-8fe9-ff88d7258e7e None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77661) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[ 1019.486543] env[77661]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-8fcd1743-4089-46c0-8fe9-ff88d7258e7e None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[ 1019.486691] env[77661]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-8fcd1743-4089-46c0-8fe9-ff88d7258e7e None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=77661) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[ 1021.492701] env[77661]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-8fcd1743-4089-46c0-8fe9-ff88d7258e7e None None] Session token - acquiring
[ 1021.493065] env[77661]: DEBUG networking_nsxv3.common.locking [None req-8fcd1743-4089-46c0-8fe9-ff88d7258e7e None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=77661) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[ 1021.493171] env[77661]: DEBUG oslo_concurrency.lockutils [None req-8fcd1743-4089-46c0-8fe9-ff88d7258e7e None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77661) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[ 1021.493291] env[77661]: DEBUG oslo_concurrency.lockutils [None req-8fcd1743-4089-46c0-8fe9-ff88d7258e7e None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77661) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[ 1021.493557] env[77661]: DEBUG oslo_concurrency.lockutils [None req-8fcd1743-4089-46c0-8fe9-ff88d7258e7e None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77661) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[ 1021.503231] env[77661]: DEBUG oslo_concurrency.lockutils [None req-8fcd1743-4089-46c0-8fe9-ff88d7258e7e None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77661) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[ 1021.503477] env[77661]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-8fcd1743-4089-46c0-8fe9-ff88d7258e7e None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[ 1021.503619] env[77661]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-8fcd1743-4089-46c0-8fe9-ff88d7258e7e None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=77661) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[ 1023.504941] env[77661]: CRITICAL neutron [None req-8fcd1743-4089-46c0-8fe9-ff88d7258e7e None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[ 1023.504941] env[77661]: ERROR neutron Traceback (most recent call last):
[ 1023.504941] env[77661]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[ 1023.504941] env[77661]: ERROR neutron     sys.exit(main())
[ 1023.504941] env[77661]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[ 1023.504941] env[77661]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[ 1023.504941] env[77661]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[ 1023.504941] env[77661]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[ 1023.504941] env[77661]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[ 1023.504941] env[77661]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[ 1023.504941] env[77661]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[ 1023.504941] env[77661]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[ 1023.504941] env[77661]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[ 1023.504941] env[77661]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[ 1023.504941] env[77661]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[ 1023.504941] env[77661]: ERROR neutron     response = self.get(path=path, params=params)
[ 1023.505800] env[77661]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[ 1023.505800] env[77661]: ERROR neutron     raise RuntimeError(msg, last_err)
[ 1023.505800] env[77661]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[ 1023.505800] env[77661]: ERROR neutron 
[ 1025.919076] env[77668]: INFO neutron.common.config [-] Logging enabled!
[ 1025.919489] env[77668]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[ 1025.919610] env[77668]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=77668) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[ 1025.919813] env[77668]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[ 1025.919905] env[77668]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[ 1025.920853] env[77668]: WARNING oslo_policy.policy [None req-5e0d054c-c28a-42bd-8624-e74d6186a183 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[ 1025.921098] env[77668]: WARNING oslo_policy.policy [None req-5e0d054c-c28a-42bd-8624-e74d6186a183 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[ 1025.922317] env[77668]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-5e0d054c-c28a-42bd-8624-e74d6186a183 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[ 1025.936401] env[77668]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5e0d054c-c28a-42bd-8624-e74d6186a183 None None] Session token - acquiring
[ 1025.937150] env[77668]: DEBUG networking_nsxv3.common.locking [None req-5e0d054c-c28a-42bd-8624-e74d6186a183 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=77668) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[ 1025.937346] env[77668]: DEBUG oslo_concurrency.lockutils [None req-5e0d054c-c28a-42bd-8624-e74d6186a183 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77668) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[ 1025.937473] env[77668]: DEBUG oslo_concurrency.lockutils [None req-5e0d054c-c28a-42bd-8624-e74d6186a183 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77668) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[ 1025.937829] env[77668]: DEBUG oslo_concurrency.lockutils [None req-5e0d054c-c28a-42bd-8624-e74d6186a183 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77668) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[ 1025.946552] env[77668]: DEBUG oslo_concurrency.lockutils [None req-5e0d054c-c28a-42bd-8624-e74d6186a183 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77668) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[ 1025.946796] env[77668]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5e0d054c-c28a-42bd-8624-e74d6186a183 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[ 1025.946943] env[77668]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5e0d054c-c28a-42bd-8624-e74d6186a183 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=77668) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[ 1027.953119] env[77668]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5e0d054c-c28a-42bd-8624-e74d6186a183 None None] Session token - acquiring
[ 1027.953588] env[77668]: DEBUG networking_nsxv3.common.locking [None req-5e0d054c-c28a-42bd-8624-e74d6186a183 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=77668) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[ 1027.953771] env[77668]: DEBUG oslo_concurrency.lockutils [None req-5e0d054c-c28a-42bd-8624-e74d6186a183 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77668) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[ 1027.953897] env[77668]: DEBUG oslo_concurrency.lockutils [None req-5e0d054c-c28a-42bd-8624-e74d6186a183 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77668) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[ 1027.954192] env[77668]: DEBUG oslo_concurrency.lockutils [None req-5e0d054c-c28a-42bd-8624-e74d6186a183 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77668) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[ 1027.963138] env[77668]: DEBUG oslo_concurrency.lockutils [None req-5e0d054c-c28a-42bd-8624-e74d6186a183 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77668) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[ 1027.963371] env[77668]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5e0d054c-c28a-42bd-8624-e74d6186a183 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[ 1027.963510] env[77668]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5e0d054c-c28a-42bd-8624-e74d6186a183 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=77668) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[ 1029.966489] env[77668]: CRITICAL neutron [None req-5e0d054c-c28a-42bd-8624-e74d6186a183 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[ 1029.966489] env[77668]: ERROR neutron Traceback (most recent call last):
[ 1029.966489] env[77668]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[ 1029.966489] env[77668]: ERROR neutron     sys.exit(main())
[ 1029.966489] env[77668]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[ 1029.966489] env[77668]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[ 1029.966489] env[77668]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[ 1029.966489] env[77668]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[ 1029.966489] env[77668]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[ 1029.966489] env[77668]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[ 1029.966489] env[77668]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[ 1029.966489] env[77668]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[ 1029.966489] env[77668]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[ 1029.966489] env[77668]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[ 1029.966489] env[77668]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[ 1029.966489] env[77668]: ERROR neutron     response = self.get(path=path, params=params)
[ 1029.970626] env[77668]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[ 1029.970626] env[77668]: ERROR neutron     raise RuntimeError(msg, last_err)
[ 1029.970626] env[77668]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[ 1029.970626] env[77668]: ERROR neutron 
[ 1032.386452] env[77677]: INFO neutron.common.config [-] Logging enabled!
[ 1032.387093] env[77677]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[ 1032.387177] env[77677]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=77677) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[ 1032.387341] env[77677]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[ 1032.387436] env[77677]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[ 1032.388261] env[77677]: WARNING oslo_policy.policy [None req-3aa3867e-3563-4c49-8abf-fbf673bed699 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[ 1032.388491] env[77677]: WARNING oslo_policy.policy [None req-3aa3867e-3563-4c49-8abf-fbf673bed699 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[ 1032.389660] env[77677]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-3aa3867e-3563-4c49-8abf-fbf673bed699 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[ 1032.404246] env[77677]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3aa3867e-3563-4c49-8abf-fbf673bed699 None None] Session token - acquiring
[ 1032.405060] env[77677]: DEBUG networking_nsxv3.common.locking [None req-3aa3867e-3563-4c49-8abf-fbf673bed699 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=77677) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[ 1032.405263] env[77677]: DEBUG oslo_concurrency.lockutils [None req-3aa3867e-3563-4c49-8abf-fbf673bed699 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77677) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[ 1032.405389] env[77677]: DEBUG oslo_concurrency.lockutils [None req-3aa3867e-3563-4c49-8abf-fbf673bed699 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77677) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[ 1032.405747] env[77677]: DEBUG oslo_concurrency.lockutils [None req-3aa3867e-3563-4c49-8abf-fbf673bed699 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77677) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[ 1032.414559] env[77677]: DEBUG oslo_concurrency.lockutils [None req-3aa3867e-3563-4c49-8abf-fbf673bed699 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77677) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[ 1032.414805] env[77677]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3aa3867e-3563-4c49-8abf-fbf673bed699 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[ 1032.414956] env[77677]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3aa3867e-3563-4c49-8abf-fbf673bed699 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=77677) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[ 1034.420950] env[77677]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3aa3867e-3563-4c49-8abf-fbf673bed699 None None] Session token - acquiring
[ 1034.421449] env[77677]: DEBUG networking_nsxv3.common.locking [None req-3aa3867e-3563-4c49-8abf-fbf673bed699 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=77677) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[ 1034.421594] env[77677]: DEBUG oslo_concurrency.lockutils [None req-3aa3867e-3563-4c49-8abf-fbf673bed699 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77677) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[ 1034.421718] env[77677]: DEBUG oslo_concurrency.lockutils [None req-3aa3867e-3563-4c49-8abf-fbf673bed699 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77677) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[ 1034.421996] env[77677]: DEBUG oslo_concurrency.lockutils [None req-3aa3867e-3563-4c49-8abf-fbf673bed699 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77677) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[ 1034.430763] env[77677]: DEBUG oslo_concurrency.lockutils [None req-3aa3867e-3563-4c49-8abf-fbf673bed699 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77677) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[ 1034.430992] env[77677]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3aa3867e-3563-4c49-8abf-fbf673bed699 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[ 1034.431135] env[77677]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3aa3867e-3563-4c49-8abf-fbf673bed699 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=77677) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[ 1036.434096] env[77677]: CRITICAL neutron [None req-3aa3867e-3563-4c49-8abf-fbf673bed699 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[ 1036.434096] env[77677]: ERROR neutron Traceback (most recent call last):
[ 1036.434096] env[77677]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[ 1036.434096] env[77677]: ERROR neutron     sys.exit(main())
[ 1036.434096] env[77677]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[ 1036.434096] env[77677]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[ 1036.434096] env[77677]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[ 1036.434096] env[77677]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[ 1036.434096] env[77677]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[ 1036.434096] env[77677]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[ 1036.434096] env[77677]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[ 1036.434096] env[77677]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[ 1036.434096] env[77677]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[ 1036.434096] env[77677]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[ 1036.434096] env[77677]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[ 1036.434096] env[77677]: ERROR neutron     response = self.get(path=path, params=params)
[ 1036.435423] env[77677]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[ 1036.435423] env[77677]: ERROR neutron     raise RuntimeError(msg, last_err)
[ 1036.435423] env[77677]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[ 1036.435423] env[77677]: ERROR neutron 
[ 1038.907051] env[77726]: INFO neutron.common.config [-] Logging enabled!
[ 1038.907419] env[77726]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[ 1038.907545] env[77726]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=77726) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[ 1038.907768] env[77726]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[ 1038.907867] env[77726]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[ 1038.908781] env[77726]: WARNING oslo_policy.policy [None req-0b37c486-2072-48ee-8cd8-085bf564ced6 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[ 1038.909022] env[77726]: WARNING oslo_policy.policy [None req-0b37c486-2072-48ee-8cd8-085bf564ced6 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[ 1038.910223] env[77726]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-0b37c486-2072-48ee-8cd8-085bf564ced6 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[ 1038.924560] env[77726]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-0b37c486-2072-48ee-8cd8-085bf564ced6 None None] Session token - acquiring
[ 1038.925302] env[77726]: DEBUG networking_nsxv3.common.locking [None req-0b37c486-2072-48ee-8cd8-085bf564ced6 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=77726) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[ 1038.925504] env[77726]: DEBUG oslo_concurrency.lockutils [None req-0b37c486-2072-48ee-8cd8-085bf564ced6 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77726) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[ 1038.925631] env[77726]: DEBUG oslo_concurrency.lockutils [None req-0b37c486-2072-48ee-8cd8-085bf564ced6 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77726) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[ 1038.925984] env[77726]: DEBUG oslo_concurrency.lockutils [None req-0b37c486-2072-48ee-8cd8-085bf564ced6 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77726) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[ 1038.935001] env[77726]: DEBUG oslo_concurrency.lockutils [None req-0b37c486-2072-48ee-8cd8-085bf564ced6 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77726) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[ 1038.935245] env[77726]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-0b37c486-2072-48ee-8cd8-085bf564ced6 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[ 1038.935395] env[77726]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-0b37c486-2072-48ee-8cd8-085bf564ced6 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=77726) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[ 1040.941465] env[77726]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-0b37c486-2072-48ee-8cd8-085bf564ced6 None None] Session token - acquiring
[ 1040.941811] env[77726]: DEBUG networking_nsxv3.common.locking [None req-0b37c486-2072-48ee-8cd8-085bf564ced6 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=77726) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[ 1040.941975] env[77726]: DEBUG oslo_concurrency.lockutils [None req-0b37c486-2072-48ee-8cd8-085bf564ced6 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77726) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[ 1040.942103] env[77726]: DEBUG oslo_concurrency.lockutils [None req-0b37c486-2072-48ee-8cd8-085bf564ced6 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77726) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[ 1040.942382] env[77726]: DEBUG oslo_concurrency.lockutils [None req-0b37c486-2072-48ee-8cd8-085bf564ced6 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77726) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[ 1040.951392] env[77726]: DEBUG oslo_concurrency.lockutils [None req-0b37c486-2072-48ee-8cd8-085bf564ced6 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77726) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[ 1040.951623] env[77726]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-0b37c486-2072-48ee-8cd8-085bf564ced6 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[ 1040.951763] env[77726]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-0b37c486-2072-48ee-8cd8-085bf564ced6 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=77726) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[ 1042.954728] env[77726]: CRITICAL neutron [None req-0b37c486-2072-48ee-8cd8-085bf564ced6 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[ 1042.954728] env[77726]: ERROR neutron Traceback (most recent call last):
[ 1042.954728] env[77726]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[ 1042.954728] env[77726]: ERROR neutron     sys.exit(main())
[ 1042.954728] env[77726]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[ 1042.954728] env[77726]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[ 1042.954728] env[77726]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[ 1042.954728] env[77726]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[ 1042.954728] env[77726]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[ 1042.954728] env[77726]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[ 1042.954728] env[77726]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[ 1042.954728] env[77726]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[ 1042.954728] env[77726]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[ 1042.954728] env[77726]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[ 1042.954728] env[77726]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[ 1042.954728] env[77726]: ERROR neutron     response = self.get(path=path, params=params)
[ 1042.955623] env[77726]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[ 1042.955623] env[77726]: ERROR neutron     raise RuntimeError(msg, last_err)
[ 1042.955623] env[77726]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[ 1042.955623] env[77726]: ERROR neutron 
[ 1045.438735] env[77801]: INFO neutron.common.config [-] Logging enabled!
[ 1045.439114] env[77801]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43
[ 1045.439233] env[77801]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=77801) setup_logging /opt/stack/neutron/neutron/common/config.py:123}}
[ 1045.439392] env[77801]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ...
[ 1045.439486] env[77801]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed.
[ 1045.440345] env[77801]: WARNING oslo_policy.policy [None req-e48255ac-da71-4e4f-bf7c-d125b9033869 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[ 1045.440570] env[77801]: WARNING oslo_policy.policy [None req-e48255ac-da71-4e4f-bf7c-d125b9033869 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
[ 1045.441706] env[77801]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-e48255ac-da71-4e4f-bf7c-d125b9033869 None None] Looking for TransportZone with name nsx-vlan-transportzone.
[ 1045.455657] env[77801]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e48255ac-da71-4e4f-bf7c-d125b9033869 None None] Session token - acquiring
[ 1045.456422] env[77801]: DEBUG networking_nsxv3.common.locking [None req-e48255ac-da71-4e4f-bf7c-d125b9033869 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=77801) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[ 1045.456617] env[77801]: DEBUG oslo_concurrency.lockutils [None req-e48255ac-da71-4e4f-bf7c-d125b9033869 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77801) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[ 1045.456743] env[77801]: DEBUG oslo_concurrency.lockutils [None req-e48255ac-da71-4e4f-bf7c-d125b9033869 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77801) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[ 1045.457097] env[77801]: DEBUG oslo_concurrency.lockutils [None req-e48255ac-da71-4e4f-bf7c-d125b9033869 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77801) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[ 1045.465878] env[77801]: DEBUG oslo_concurrency.lockutils [None req-e48255ac-da71-4e4f-bf7c-d125b9033869 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77801) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[ 1045.466123] env[77801]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e48255ac-da71-4e4f-bf7c-d125b9033869 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[ 1045.467890] env[77801]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e48255ac-da71-4e4f-bf7c-d125b9033869 None None] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=77801) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[ 1047.472390] env[77801]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e48255ac-da71-4e4f-bf7c-d125b9033869 None None] Session token - acquiring
[ 1047.472732] env[77801]: DEBUG networking_nsxv3.common.locking [None req-e48255ac-da71-4e4f-bf7c-d125b9033869 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=77801) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}}
[ 1047.472919] env[77801]: DEBUG oslo_concurrency.lockutils [None req-e48255ac-da71-4e4f-bf7c-d125b9033869 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77801) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}}
[ 1047.473046] env[77801]: DEBUG oslo_concurrency.lockutils [None req-e48255ac-da71-4e4f-bf7c-d125b9033869 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77801) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
[ 1047.473321] env[77801]: DEBUG oslo_concurrency.lockutils [None req-e48255ac-da71-4e4f-bf7c-d125b9033869 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77801) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}}
[ 1047.482359] env[77801]: DEBUG oslo_concurrency.lockutils [None req-e48255ac-da71-4e4f-bf7c-d125b9033869 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=77801) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}}
[ 1047.482590] env[77801]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e48255ac-da71-4e4f-bf7c-d125b9033869 None None] Request=Function GET Argumetns {'path': '/api/v1/transport-zones', 'params': {'page_size': 200, 'cursor': ''}} Response=403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create: requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create
[ 1047.482729] env[77801]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e48255ac-da71-4e4f-bf7c-d125b9033869 None None] Retrying connection (2/2) with timeout 2s for Client.get {{(pid=77801) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}}
[ 1049.485655] env[77801]: CRITICAL neutron [None req-e48255ac-da71-4e4f-bf7c-d125b9033869 None None] Unhandled error: RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[ 1049.485655] env[77801]: ERROR neutron Traceback (most recent call last):
[ 1049.485655] env[77801]: ERROR neutron   File "/opt/stack/data/venv/bin/neutron-nsxv3-agent", line 10, in <module>
[ 1049.485655] env[77801]: ERROR neutron     sys.exit(main())
[ 1049.485655] env[77801]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 331, in main
[ 1049.485655] env[77801]: ERROR neutron     NSXv3Manager(rpc=nsxv3_rpc.NSXv3ServerRpcApi()),
[ 1049.485655] env[77801]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py", line 145, in __init__
[ 1049.485655] env[77801]: ERROR neutron     self.mngr_provider = provider_nsx_mgmt.Provider()
[ 1049.485655] env[77801]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 443, in __init__
[ 1049.485655] env[77801]: ERROR neutron     super(Provider, self).__init__(client=Client(), zone_id=None)
[ 1049.485655] env[77801]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py", line 207, in __init__
[ 1049.485655] env[77801]: ERROR neutron     self.zone_id, self.zone_tags = self._load_zones()
[ 1049.485655] env[77801]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py", line 454, in _load_zones
[ 1049.485655] env[77801]: ERROR neutron     for zone in self.client.get_all(path="/api/v1/transport-zones"):
[ 1049.485655] env[77801]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 276, in get_all
[ 1049.485655] env[77801]: ERROR neutron     response = self.get(path=path, params=params)
[ 1049.486344] env[77801]: ERROR neutron   File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 129, in decorator
[ 1049.486344] env[77801]: ERROR neutron     raise RuntimeError(msg, last_err)
[ 1049.486344] env[77801]: ERROR neutron RuntimeError: ('Retrying connection (2/2) with timeout 2s for Client.get', HTTPError('403 Client Error: Forbidden for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/api/session/create'))
[ 1049.486344] env[77801]: ERROR neutron