Stress

Are you going to be stressed at your job? Uh...do Bumbles bounce? (Yes. Yes they do.)

 
You're already the right height. Just make sure you buy a tuxedo before the transfer goes through. (Source)

Like we said, working elves feel a near-constant pressure to be perfect. Slip up even once, and next thing you know you might very well find yourself shipped to the South Pole.

Working conditions up north are crowded and hectic. There's no privacy, you'll never have your own corner office, and if you don't need a hearing aid before the age of three hundred, you'll be in the minority. 

The deadlines are pretty tame for most of the year, but once December rolls around...you should have your stress ball, relaxation techniques, and bottle of Advil on hand. No excuses at that time of year, and things can get pretty dicey in a hurry.

Also, you'll have to constantly worry about incurring any major medical expenses, because the HMO Santa offers barely covers paper cuts.