Have you got any tear away stabiliser? Will help support the fabric but you can pull it off after stitching
I do it a lot with embroidery on that sort of fabric. It gets ironed on, supports and then tears off like a dream
I would imagine the sort of stitching that happens with buttonholes is similar to embroidery.