I have holes on my top and bottom, holes on my left and my right and I have holes in my middle, yet still I hold water. What am I?

A sponge.

Source: Riotous Riddles