This saying is used in those situations in which there´s a hidden factor that prevents us from knowing what´s really going on. There´s something suspicious and it makes no sense. The English equivalent would be "There´s something fishy going on here".

Among several theories, the strongest one talks about the Middle Ages, when women wore purses made out of cat skin and they hid them underneath their clothes to protect their money from being stolen.