Add ice cream, pumpkin, milk, and bourbon in a blender until smooth (about 1/3 at a time). Add the sugar and spices to the last batch. Pour into a pitcher and stir. Pour into glasses and top with whipped cream and sprinkle with nutmeg.