I personally really like the cap, it is very different from what you normally see. I wouldn't throw it away if removed. Maybe pas sit on to someone that might do something with it. Caulk has its purposes but there have to be a better way to connect them than that.
Looks great, beautiful color combos.