Cats will still produce milk after they have given birth for a long time, or even if they have suffered a miscarriage. This is normal.
However, if the situation is as bad as you describe, then the best idea would be to take your cat to the vets - who can undertake a thorough examination of your pet.
Although the milk should eventually go on its own, the vet can give your pet an injection or medication to speed up this process.
My cat's breasts are still full of milk - what can I do?
This is not unusual in the feline world, although it could cause the mother cat a great deal of discomfort.
Some kittens will take milk from their mothers for longer than others, as it depends on how quickly they develop. However, weaning normally starts at about three to four weeks after birth, and can continue until the kittens are about six to eight weeks old.