Nope! Just as long as the elastomer is on the top, it does not matter if it is on the left or the right. Also, make sure the elastomer handle is on the outside, not the inside.
Please note, if you have a 55mm or 70mm stem, it will not work with flat bars.