Two ways to fix that that I know...
One is to use some two part epoxy, and some small bits of Fiberglass. Just coat the pieces, and lay the cloth into the epoxy. Do a few layers using thin lightweight cloth. When it cures, trim it up, and drill the new hole. You HAVE to scratch up everywhere the glue will touch w/ 80 grit sandpaper first.
Second is to drill matching 1/4" holes in each of the mating panels. You can use a "Zip Tie" to secure them. It's usually easy to mount it so the zip part is inside the panels, and it can not be seen. Next time you have to remove the panel, just cut, and replace the tie(s).
My little ZX race bike has all the panels glassed together, and held in place w/ zip ties. It takes about 45 seconds to strip my bike to the frame. Plus the bike does better than 80mph, and nothing rattles.