I used to get a lot of hate just for using Comic Sans for what it was originally intended for; comic bubbles. This happened in middle school, by the way. Some people are just never happy.
I use Mighty Zeo or Anime Ace nowadays, but I'll still never forget being bullied for using a comic book font in my comics during computer lab.
I'm going to say no, it's not fair. Neither is hating Papyrus just for existing. You don't have to use it, you can ignore it, and the font used for the first Avatar movie wasn't even Papyrus, it was an original font that happened to look alike.