Lesotho recorded its first case of COVID-19 on Wednesday, the health ministry said, becoming the last country in southern and East Africa to be afflicted by the virus.