Can't access the aaPanel from public IP - aaPanel - Hosting control panel. One-click LAMP/LEMP.

What I did.
Made sure that the ports are open on the VPS Firewall. (Just to be sure I wasn't making any mistake, I opened up all the ports) - Still not accessable.
Connected to the VPS using SSH. And tunneled port 80 and 8888. Now it did work. I was able to access the aaPanel dashboard and install Nginx stack.
Deleted and added firewall entries to allow port 80, 443, 8888, 888. Still not accessible over public IP.
Installed Docker from the aaPanel itself and installed Portainer. Portainer has a web UI at port 9000. I tried to access this UI and again. IT WORKS.
At this time I am sure that it something to do with aaPanel itself. Or is it me doing something wrong? I even disabled the ubuntu firewall using the command sudo ufw disable.

Output of sudo lsof -i:80

COMMAND  PID        USER   FD   TYPE DEVICE SIZE/OFF NODE NAME
nginx   1109        root    9u  IPv4  20409      0t0  TCP *:http (LISTEN)
nginx   1111         www    9u  IPv4  20409      0t0  TCP *:http (LISTEN)
nginx   1112         www    9u  IPv4  20409      0t0  TCP *:http (LISTEN)
nginx   1113         www    9u  IPv4  20409      0t0  TCP *:http (LISTEN)
nginx   1114         www    9u  IPv4  20409      0t0  TCP *:http (LISTEN)