I would recommend sanding it at the least, but it might be better to talk to local plasterers to see if they can recommend what grit to use, or whether there is an etching compound/primer that can be used, or special plaster primer that will embed into the plaster for a sturdy base for paint.

You can also try a Google search of "+painting +plaster", there seem to be a good number of matches that might help.