That's most likely from oily hands touching those areas opening/closing the doors.
I make it a habit to ONLY touch the door handles, and suggest you do the same; and then, you can make any passengers who fail to meet this request get out of the vehicle immediately and walk