Chapter 2. military

uncertainty as we need to be able to do if we have agents in

stochastic and non-deterministic environments and

partially observable environments where we don't see

the state of the world in one go and where we are not sure

that our actions will actually succeed.

Typical thing, Wumpus World, which is partially observable because in the cave is dark.

So you're getting full observation information here just to explain the game.

But of course our agent, because it's dark, cannot see anything and can only feel breezes

and stench and glitter and all of those kind of things.

And of course we might have non-deterministic actions,

where my plan is to go forward or into cell 2-1,

but I actually end up in cell 1-2.

Remember it's dark, sometimes actions don't succeed.

So we have unreliable sensors, partial observability, and unreliable actions.

Those are very common things.

Think of having a robot that not just is in a lab, but goes outside, say a self-driving car.

One of the most important things for the robot is to know where am I, where do I want to go, and all of those kind of things.

And they're all unreliable.