5. Consider the following data set for a binary class problem. A B Class Label T F T T

November 22, 2020

5. Consider the following data set for a binary class problem.
A B Class Label
T F +
T T +
T T +
T F ?
T T +
F F ?
F F ?
F F ?
T T ?
T F ?
a. Calculate the information gain when splitting on A and B. Which
attribute would the decision tree induction algorithm choose?
b. Calculate the gain in the Gini index when splitting on A and B.
Which attribute would the decision tree induction algorithm
choose?
c. Figure 3.11 shows that entropy and the Gini index are both
monotonically increasing on the range [0, 0.5] and they are both
monotonically decreasing on the range [0.5, 1]. Is it possible that
information gain and the gain in the Gini index favor different
attributes? Explain.
7. Consider the following set of training examples.
X Y Z No. of Class C1 Examples No. of Class C2 Examples
0 0 0 5 40
0 0 1 0 15
0 1 0 10 5
0 1 1 45 0
1 0 0 10 5
1 0 1 25 0
1 1 0 5 20
1 1 1 0 15
a. Compute a two-level decision tree using the greedy approach
described in this chapter. Use the classification error rate as the
criterion for splitting. What is the overall error rate of the induced
tree?
b. Repeat part (a) using X as the first splitting attribute and then
choose the best remaining attribute for splitting at each of the two
successor nodes. What is the error rate of the induced tree?
c. Compare the results of parts (a) and (b). Comment on the suitability
of the greedy heuristic used for splitting attribute selection.
8. The following table summarizes a data set with three attributes A, B,
C and two class labels +, ?. Build a two-level decision tree.
A B C
Number of Instances
+ ?
T T T 5 0
F T T 0 20
T F T 20 0
F F T 0 5
T T F 0 0
F T F 25 0
T F F 0 0
F F F 0 25
a. According to the classification error rate, which attribute would be
chosen as the first splitting attribute? For each attribute, show the
contingency table and the gains in classification error rate.
b. Repeat for the two children of the root node.
c. How many instances are misclassified by the resulting decision
tree?
d. Repeat parts (a), (b), and (c) using C as the splitting attribute.
e. Use the results in parts (c) and (d) to conclude about the greedy
nature of the decision tree induction algorithm.

Share This Post

Order a Similar Paper and get 15% Discount on your First Order

Our Services

5. Consider the following data set for a binary class problem. A B Class Label T F T T

Share This Post

Related Questions

Business Finance – Operations Management Operations Management (Excel) Assignment

Upon graduation, you’re hired by a consulting firm. Your first client is the Archer-Daniels-Midland Corporation (ticker: ADM). ADM is a large agribusiness

Fildena Double 200 to Fix Your Sexual Relationship | cheaptrustedpharmacy

Government Assignment2 Negotiating as a leadership skill

Use Westlaw Edge (website. MUST USE)

Among the Enlightenment’s many contributions to modern life was a new form of political discourse: the political cartoon. We see these in newspapers and on

For this Discussion, answer ONE of the instructor-provided questions: The French revolutionaries claimed that they were inspired by the Enlightenment

For this Discussion, answer one of the instructor-provided questions: CH 10 Historians often consider France’s Louis XIV the quintessential absolutist monarch.

do all of the following: Do some search and look through different forms of media (e.g., movies, shows, news articles, magazines, advertisements, music

do all of the following: Find a scholarly peer-reviewed article about weight stigma or weight bias via PsycINFOLinks to an external site. or other scholarly

You have watched a talk about Health Bank account. If you have not done so already, please watch the Health Bank Account video

I need help with this assignment. There are 3 parts of this assignment. Please take a look at the instructions that are attached. Let me know if you have a

ASSIGNMENT 1: THEORIES OF DEVELOPMENT PRESENTATION In this assignment for this week you will need to create a Prezi. (www.prezi.com. Students can start a

I need help with this assignment. There are 3 parts of this assignment. Please take a look at the instructions that are attached. Let me know if you have a

hi i wanted help with an assignment from healthcare emergency preparedness i am attaching an instruction pdf file describing the requirements of assignmentTwo

research paper regarding an actual organization of your choice that is either contemplating using and/or has already implemented the use of a team-based

I need help with this assignment. There are 3 parts of this assignment. Please take a look at the instructions that are attached. Let me know if you have a

MBA 687 Module Four Presentation Guidelines and Rubric Overview In Milestone One, as an HR consultant, you submitted a change readiness report. While you were

Use Our 6 Free Tools