Reported a bug
The tasks in Gradle panel on right side are missing in Android Studio 4.0
Filed a bug in Android Studio 4.0 where Gradle tasks are missing but in 4.1 Canary 10 everything is fine.
Issue:
https://issuetracker.google.com/issues/157981140