As of today, there is not single command from letsencrypt side to remove the letsencrypt certificate for a selected/given domain, but I manually removed the certificate using the below commands,
sudo rm -rf /etc/letsencrypt/live/<YOUR_DOMAIN>/
sudo rm -rf /etc/letsencrypt/renewal/<YOUR_DOMAIN>.conf