Abstract: An important feature of sequential decision-making under uncertain conditions is to strike a balance between exploration (obtaining information about the value of actions) and utilization ...