The more stretch factor, the more they will stretch out after you begin wearing them and you will want to make sure they fit quite snug at the time of purchase.
A good rule of thumb to remember is that you should be able to put at least two fingers between in the waistband area.
Just too many shoes to wear with skinnies to fit into one post! Similarly, if the hip area is too big they will appear bulky and bunchy.