Unless your system is explicitly designed to perform well at unbounded scale, impose a limit. Do not allow the system to simply degrade in performance at "unlikely" scales.

Users can and will abuse the amount of things they can cram into any opening you provide.