I'm for toughness applying to falling damage, but worn armor not.
When it comes to power armor and spells however, it seems like it should protect....