Sugary carbs will do the same to me, as will dairy (clarified butter I can do ok). I'd cut the fruit first, as others suggested. Are you having any milk or milk products? Nuts can also break some people out.
A zinc supplement can help heal up the acne lesions a little faster. Most people on paleo don't find this to be necessary, since eventually, diet alone usually fixes it up.