Selfhosted with docker, cannot authenticate

I am trying to self host with docker following these instructions. Everything works fine until I need to navigate to where I am getting the following error

{"success":false,"message":"Authentication failure. Missing access token","triggerOauth2SSOLoginAutomatically":false,"triggerSamlLoginAutomatically":false}

. Note, I am actually navigating since I had to one change some ports since port 3000 was already taken and I can access it from a different machine (on the same network though).

Any help is appreciated!