As long as you make sure the trousers are spread evenly along the elastic, go ahead and sew. The elastic will still stretch in all the gaps. Also, the stitching will help stop the elastic rolling over when you wear them. Sometimes i sew across the elastic in a couple of places, just to stop that happening.