In a medium pot, combine the white and brown sugars, the corn syrup, butter, heavy cream, and evaporated milk. Cook the mixture over medium heat, stirring constantly. When a candy thermometer reaches 250 degrees F, remove the pot from the heat and stir in the vanilla.