The easiest (and most attractive) solution for a shower caddy that won’t stay in place is silicone tape. Simply wrap it around your showerhead a few times, making a thicker ring for your caddy to clamp onto. The tape is self-binding but easy enough to peel back and remove, and it’s more translucent and less noticeable than alternatives like rubber bands or duct tape. You can also use zip ties, which aren’t very noticeable yet are very effective.