Todd Howard, the boss of publisher Bethesda, had long dreamed of making an Indiana Jones game and oversaw the project.
But, Troy says, he "rolled his eyes" when the actor was first put forward.
Howard felt it would ruin the experience for players so used to hearing him.
"I never thought that my success would actually work against me," says Troy.
Rather than walk into the role, Troy says, he had to audition with dozens of others.
It eventually came down to him and and one other actor. The decision was left to a test audience and a "blind taste test" where they had to choose the performance they preferred.
"Todd Howard said they picked you every time," Troy says.
"And I thought that was a compliment.
"He was like: 'No, it's a challenge. That's the standard'."