How does the computational time changes when we decrease the k
in k-fold cross validation? Why? Explain.
b. In which procedures, we can apply k-fold cross validation.
Consider all the procedures that we learned.
[USING R & dataset “Boston”] Using the leave-one-out
cross-validation and 5-fold cross-validation techniques to compare
the performance of models in (a) and (b) with:
(a) SalesPredict <- lm(Sales ~ Price + Urban + US, data =
Carseats)
(b) SalesRevise <- lm(Sales ~ Price + US, data =
Carseats)
Hint: Functions update (with option subset) and predict.
Suppose you want to use Naive Bayes to perform document
classification (binary clas-
sification) using the bag of words model where we have D documents
and a total of n
words. How many probabilities would a Naive Bayes classifier need
to learn? Suppose,
your boss says, change the order of sentences in each document and
re-learn the Naive
Bayes classifier, do you expect the learned model to be different?
Briefly explain
Verification and Validation of Simulation Models
3. How to build a model that is well connected with the
verification and validation process?
4. What is meant by calibration, and what is the process of
calibration so that it can obtain a model that means to be used for
simulation?