Do I really need to use primer in the room I drywalled?

Okay...so I put in new drywall...mudded it as needed a couple of times...sanded...did a final all wall mudding. Did a smooth and careful job. Kind of a utility room and guest bedroom. Most people say use primer before painting..but there seems to be a strong minority position that it is not necessary. I would prefer to just put down a couple of coats of paint. If that is what I end up doing...any suggestions...really super duper paint...or...really...gotta do primer? Thanks for suggestions!