Could it be the metal from the clothespins?
If it doesnt come of when you wash it and the gel in other ways are not damaged/punctured, i cant see that it could be harmfull.