Is it like a patch of skin without fur? if so it might be a skin irritation that your dog has rubbed raw. but yes I would suggest a trip to the vet
My Dog Has A Cut Like Thing On His Lip, What Do I Do?
You might want to take him to the vet to see if the vet can proscribe something for it. Make sure that it doesn't get infected and keep it clean