You are sitting home in your easy chair and suddenly you hear your toilet running and then it stops. This is called a “Ghost Flush” and it can run your water bill up significantly over a period of time.
I definitely suggest that you call a plumber. I did and it only cost me One Hundred dollars to get the thing fixed. I consider that money well spent.