Should I return my new sewing machine to the store because it jammed?

I suggest you read the manual. There should be a troubleshooting guide included with the machine. Jamming is actually a common problem with new sewers. Try practicing first by sewing on a piece of paper. That way you will have a better view of what is going wrong without ruining clothes. Sounds like you have the tension set too tightly.