PROBLEM SOLVED!! - I found that one of the motors was way overheating - around 130 F.
What fooled me this whole time, was that the drone was hovering perfectly, so I assumed all the motors were fine.
I'm purely guessing here, but I think the flight controller was detecting that one of the...