Q: Why is model evaluation difficult?

- 1 Answers
why is model evaluation difficult?, please answer. thanks in advance
The table below summarises some difficulties in model evaluation.
{ class="wikitable" Border=1 cellpadding="5"
+ Why is model evaluation difficult?
! Difficulty Reaction Implied problem

The appropriate evaluation method depends on the context of the application and the data sets available
An array of various evaluation methods must be developed.
What weight should be ascribed to various performance measures?

rowspan=2 Input data sets are limited. They reflect only few of the possible scenarios.
a) Extrapolate model behaviour outside of validation domain
a) Does the model give the right result for the right reason?
We must understand model behaviour!

b) Use many data sets
b) Hard work!
Ambiguous results.

Processing of input data for model evaluation is far from trivial.
Take care!
Identify pitfalls.
Use quality indicators.
Numerous problems!

The luxury of independent data sets can rarely be afforded.
Use many data sets.
Hard work!
Ambiguous results.

There are inherent uncertainties.
Use Venkatram's conceptual framework.
Ensembles are difficult to establish.
} ...

Do you know the Answer Please Sign-in Or register in order Answer this question?

6 Other Questions:
Suggested Answer  · 1 votes
...x preferred savings accounts for use to pay for qualified medical expenses. HSAs must accompany a qualified high deductible plan (QHDP) to be allowed. Individuals or business can participate in HSA offerings. Money put in to an HSA by an employer is ... more
Suggested Answer  · 53 votes
...urance costs have nearly doubled in the last decade. In some cases, employer health insurance costs have more than doubled. The increase in health care cost has caused a "trickle down" economic policy for consumer's share of the health care burden.As... more
Suggested Answer  · 57 votes
... to this question is not because 47 million Americans cannot get health insurance. The answer is far more complex. There are millions of Americans who cannot get health insurance due to their health status. Americans with serious health conditions ar... more
Suggested Answer  · 4 votes
Does My Child Have Autism? is a book co authored by Wendy L. Stone and Theresa Foy DiGeronimo which can help you identify it as early as possible. ... more
Suggested Answer  · 4 votes
...s" that are commonly included are date of birth (and death, if applicable), location of birth, nationality, other places lived for significant times, ... more
Suggested Answer  · 12 votes
... engineering integrates physical, chemical, mathematical and computational sciences and engineering principles to study biology, medicine, behavior, a... more