Why not get a small piece of black plastic? Maybe a black guitar pick or something similar. Should be less unsightly and do the same job.
Or even take some black silicone sealant, extrude a length into some paper, let it dry solid, peel it off and then tuck it under where the rattle is, you may not see it all then.
