Exam 7: Formal Evaluation Techniques

Unsupervised evaluation can be internal or external. Which of the following is an internal method for evaluating alternative clusterings produced by the K-Means algorithm?

The standard error is defined as the square root of this computation.

Data used to optimize the parameter settings of a supervised learner model.

Selecting data so as to assure that each class is properly represented in both the training and test set.

If a real-valued attribute is normally distributed, we know that approximately 95% of all attribute values lie within

The average squared difference between classifier predicted output and actual output.

The hypothesis of no significant difference.

We have performed a supervised classification on a dataset containing 100 test set instances. Eighty of the test set instances were correctly classified. The 95% test set accuracy confidence boundaries are:

A decision tree is built to determine individuals likely to default on an unsecured loan. The null hypothesis states that an individual will not default on the loan. The decision tree correctly classifies 80% of the instances in a test dataset. Fifteen percent of the mistakes made by the model are type 1 errors. What can be said about the performance of the model?

The correlation coefficient for two real-valued attributes is -0.85. What does this value tell you?

We have built and tested two supervised learner modelsM1 and M2. We compare the test set accuracy of the models using the classical hypothesis testing paradigm using a 95% confidence setting. The computed value of P is 2.53. What can we say about this result?

Bootstrapping allows us to

The correlation between the number of years an employee has worked for a company and the salary of the employee is 0.75. What can be said about employee salary and years worked?