11 - Mathematical Basics of Artificial Intelligence, Neural Networks and Data Analytics II [ID:41441]
50 von 1112 angezeigt

So today, we will go on with the uncertainty analysis, which

we have started yesterday.

And so the basic idea was the reason for the uncertainty

is coming from the lack of possibilities

to find a unique reconstruction of the underlying hidden

variables.

And then I have claimed in the next slide

here that it's nice to have an estimation of model uncertainty,

but everybody at the end is interested in forecast

uncertainty.

And my claim yesterday was that the forecast uncertainty

is equal to the model uncertainty

if you speak about large-scale neural networks.

With the augmentation, in principle,

because of the universal approximation argument,

whatever is the complexity of the world,

large-scale neural network is able to reproduce it,

at least in a finite time horizon.

And then the second point is, if you

study such distributions here, you

will find that it contains information which

are standalone and not directly dependent on the model itself.

We have seen that if the models are large,

the distribution becomes independent of the model.

And if the ensemble is large, the details,

which means the moments, first moment, second moment,

third moment, fourth moment, become

more and more independent of the size of the ensemble.

And for this, I do not have a formal proof,

but I have shown you a lot of experiments.

For the first and the second moment here,

my statements are practically perfect.

If you go to the higher moments here,

then you see first and second moment are fine with the third.

And the fourth moment here, you really

need large ensembles to have this stability there.

Same thing with the meta parameters,

with the special design of the neural networks.

If they become larger and larger,

then the whole story is more and more

going here in the direction of a stable description

for the higher moments.

But we have discussed this experience

with the nature versus nature in a small room, which

means a whole year.

And it never worked in such a good way

that in a small hall, you can keep

the balance between all the variables there,

which is in a large nature, no topic.

And so therefore, in the future, this

Zugänglich über

Offener Zugang

Dauer

01:13:37 Min

Aufnahmedatum

2022-04-22

Hochgeladen am

2022-04-22 15:06:04

Sprache

en-US

Einbetten
Wordpress FAU Plugin
iFrame
Teilen