Those small bugs could be a variety of many things. They could be ants, bed bugs, nats ,termites, or even the basic beetle. They could be harmful. They are attracted by the food aroma in your kitchen. But if I were you I would call an exterminator immediately. You wouldn't want to risk your furniture getting damaged.