assignment 5 big data data mining for the masses



a mining model is created by applying an algorithm to data, but it is more than an algorithm or a metadata container it is a set of data and patterns that can be applied to new data to generate predictions and make inferences about relationships. 
using decision tree model to predict a customer buying behavior, to determine one of many few things such as, "if a certain amount of customer only browsed for the item or maybe had actually purchased the item", and many more.
and using the following attributes to help us gain the prediction these attributes are:
user_id, gender, age, marital_status, website_activity, browsed_electronics_12mo, bought_electronics_12mo, bought_digital_media_18mo, bought_digital_books, payment_method, e-reader_Adoption. 



results:
the picture above is the result of the frequent buyer from the decision tree

this picture is the seldom buyer from the decision tree

Tree 


Website_Activity = Frequent
|   Age > 35.500
|   |   Age > 37
|   |   |   Bought_Digital_Books = No
|   |   |   |   Age > 59
|   |   |   |   |   Gender = F
|   |   |   |   |   |   Bought_Digital_Media_18Mo = No
|   |   |   |   |   |   |   Payment_Method = Monthly Billing: Early Adopter {Late Majority=0, Innovator=0, Early Adopter=1, Early Majority=1}
|   |   |   |   |   |   |   Payment_Method = Website Account: Early Majority {Late Majority=0, Innovator=0, Early Adopter=0, Early Majority=2}
|   |   |   |   |   |   Bought_Digital_Media_18Mo = Yes: Early Adopter {Late Majority=0, Innovator=0, Early Adopter=2, Early Majority=0}
|   |   |   |   |   Gender = M: Early Majority {Late Majority=0, Innovator=0, Early Adopter=0, Early Majority=3}
|   |   |   |   Age ≤ 59
|   |   |   |   |   Payment_Method = Bank Transfer
|   |   |   |   |   |   Age > 46.500
|   |   |   |   |   |   |   Gender = F: Early Adopter {Late Majority=0, Innovator=0, Early Adopter=2, Early Majority=0}
|   |   |   |   |   |   |   Gender = M: Innovator {Late Majority=0, Innovator=2, Early Adopter=1, Early Majority=0}
|   |   |   |   |   |   Age ≤ 46.500: Innovator {Late Majority=0, Innovator=2, Early Adopter=0, Early Majority=0}
|   |   |   |   |   Payment_Method = Credit Card: Innovator {Late Majority=0, Innovator=2, Early Adopter=2, Early Majority=0}
|   |   |   |   |   Payment_Method = Monthly Billing: Early Adopter {Late Majority=0, Innovator=0, Early Adopter=2, Early Majority=0}
|   |   |   |   |   Payment_Method = Website Account: Early Adopter {Late Majority=1, Innovator=0, Early Adopter=8, Early Majority=0}
|   |   |   Bought_Digital_Books = Yes
|   |   |   |   Payment_Method = Monthly Billing: Innovator {Late Majority=0, Innovator=3, Early Adopter=1, Early Majority=0}
|   |   |   |   Payment_Method = Website Account
|   |   |   |   |   Bought_Electronics_12Mo = No: Innovator {Late Majority=0, Innovator=3, Early Adopter=0, Early Majority=0}
|   |   |   |   |   Bought_Electronics_12Mo = Yes
|   |   |   |   |   |   Marital_Status = M
|   |   |   |   |   |   |   Age > 63.500: Late Majority {Late Majority=1, Innovator=1, Early Adopter=0, Early Majority=0}
|   |   |   |   |   |   |   Age ≤ 63.500: Innovator {Late Majority=0, Innovator=3, Early Adopter=0, Early Majority=2}
|   |   |   |   |   |   Marital_Status = S: Late Majority {Late Majority=1, Innovator=1, Early Adopter=0, Early Majority=0}
|   |   Age ≤ 37: Late Majority {Late Majority=1, Innovator=1, Early Adopter=0, Early Majority=0}
|   Age ≤ 35.500: Innovator {Late Majority=0, Innovator=5, Early Adopter=0, Early Majority=0}
Website_Activity = Regular
|   Age > 65.500: Early Majority {Late Majority=1, Innovator=0, Early Adopter=0, Early Majority=3}
|   Age ≤ 65.500
|   |   Age > 63.500
|   |   |   Bought_Digital_Books = No: Late Majority {Late Majority=2, Innovator=1, Early Adopter=0, Early Majority=0}
|   |   |   Bought_Digital_Books = Yes: Innovator {Late Majority=0, Innovator=3, Early Adopter=0, Early Majority=2}
|   |   Age ≤ 63.500
|   |   |   Age > 62.500: Early Majority {Late Majority=0, Innovator=0, Early Adopter=0, Early Majority=2}
|   |   |   Age ≤ 62.500
|   |   |   |   Age > 60.500
|   |   |   |   |   Bought_Digital_Books = No: Early Majority {Late Majority=0, Innovator=0, Early Adopter=0, Early Majority=6}
|   |   |   |   |   Bought_Digital_Books = Yes: Innovator {Late Majority=0, Innovator=1, Early Adopter=1, Early Majority=0}
|   |   |   |   Age ≤ 60.500
|   |   |   |   |   Age > 21.500
|   |   |   |   |   |   Browsed_Electronics_12Mo = No
|   |   |   |   |   |   |   Bought_Digital_Books = No
|   |   |   |   |   |   |   |   Bought_Electronics_12Mo = No
|   |   |   |   |   |   |   |   |   Payment_Method = Monthly Billing: Early Adopter {Late Majority=0, Innovator=0, Early Adopter=1, Early Majority=1}
|   |   |   |   |   |   |   |   |   Payment_Method = Website Account: Early Majority {Late Majority=0, Innovator=0, Early Adopter=0, Early Majority=2}
|   |   |   |   |   |   |   |   Bought_Electronics_12Mo = Yes: Late Majority {Late Majority=1, Innovator=0, Early Adopter=1, Early Majority=0}
|   |   |   |   |   |   |   Bought_Digital_Books = Yes: Early Adopter {Late Majority=0, Innovator=0, Early Adopter=5, Early Majority=1}
|   |   |   |   |   |   Browsed_Electronics_12Mo = Yes
|   |   |   |   |   |   |   Bought_Digital_Books = No
|   |   |   |   |   |   |   |   Age > 54.500
|   |   |   |   |   |   |   |   |   Age > 57
|   |   |   |   |   |   |   |   |   |   Gender = F: Innovator {Late Majority=0, Innovator=1, Early Adopter=0, Early Majority=1}
|   |   |   |   |   |   |   |   |   |   Gender = M: Early Majority {Late Majority=0, Innovator=0, Early Adopter=0, Early Majority=2}
|   |   |   |   |   |   |   |   |   Age ≤ 57: Early Majority {Late Majority=0, Innovator=0, Early Adopter=0, Early Majority=3}
|   |   |   |   |   |   |   |   Age ≤ 54.500
|   |   |   |   |   |   |   |   |   Age > 28
|   |   |   |   |   |   |   |   |   |   Age > 38.500
|   |   |   |   |   |   |   |   |   |   |   Age > 42.500
|   |   |   |   |   |   |   |   |   |   |   |   Age > 44.500
|   |   |   |   |   |   |   |   |   |   |   |   |   Bought_Electronics_12Mo = No
|   |   |   |   |   |   |   |   |   |   |   |   |   |   Marital_Status = M: Early Adopter {Late Majority=0, Innovator=0, Early Adopter=2, Early Majority=0}
|   |   |   |   |   |   |   |   |   |   |   |   |   |   Marital_Status = S: Early Majority {Late Majority=0, Innovator=0, Early Adopter=0, Early Majority=3}
|   |   |   |   |   |   |   |   |   |   |   |   |   Bought_Electronics_12Mo = Yes
|   |   |   |   |   |   |   |   |   |   |   |   |   |   Payment_Method = Bank Transfer
|   |   |   |   |   |   |   |   |   |   |   |   |   |   |   Age > 50.500: Early Adopter {Late Majority=0, Innovator=0, Early Adopter=4, Early Majority=0}
|   |   |   |   |   |   |   |   |   |   |   |   |   |   |   Age ≤ 50.500: Innovator {Late Majority=0, Innovator=2, Early Adopter=2, Early Majority=0}
|   |   |   |   |   |   |   |   |   |   |   |   |   |   Payment_Method = Credit Card: Early Adopter {Late Majority=0, Innovator=0, Early Adopter=1, Early Majority=1}
|   |   |   |   |   |   |   |   |   |   |   |   |   |   Payment_Method = Website Account: Early Majority {Late Majority=0, Innovator=0, Early Adopter=1, Early Majority=2}
|   |   |   |   |   |   |   |   |   |   |   |   Age ≤ 44.500
|   |   |   |   |   |   |   |   |   |   |   |   |   Marital_Status = M: Late Majority {Late Majority=1, Innovator=0, Early Adopter=1, Early Majority=0}
|   |   |   |   |   |   |   |   |   |   |   |   |   Marital_Status = S: Innovator {Late Majority=0, Innovator=1, Early Adopter=0, Early Majority=1}
|   |   |   |   |   |   |   |   |   |   |   Age ≤ 42.500: Early Majority {Late Majority=0, Innovator=0, Early Adopter=0, Early Majority=4}
|   |   |   |   |   |   |   |   |   |   Age ≤ 38.500
|   |   |   |   |   |   |   |   |   |   |   Age > 29.500
|   |   |   |   |   |   |   |   |   |   |   |   Marital_Status = M
|   |   |   |   |   |   |   |   |   |   |   |   |   Bought_Electronics_12Mo = No: Early Adopter {Late Majority=0, Innovator=0, Early Adopter=8, Early Majority=0}
|   |   |   |   |   |   |   |   |   |   |   |   |   Bought_Electronics_12Mo = Yes
|   |   |   |   |   |   |   |   |   |   |   |   |   |   Age > 36: Early Adopter {Late Majority=0, Innovator=0, Early Adopter=2, Early Majority=0}
|   |   |   |   |   |   |   |   |   |   |   |   |   |   Age ≤ 36: Late Majority {Late Majority=1, Innovator=0, Early Adopter=1, Early Majority=0}
|   |   |   |   |   |   |   |   |   |   |   |   Marital_Status = S
|   |   |   |   |   |   |   |   |   |   |   |   |   Bought_Digital_Media_18Mo = No: Early Adopter {Late Majority=0, Innovator=0, Early Adopter=3, Early Majority=0}
|   |   |   |   |   |   |   |   |   |   |   |   |   Bought_Digital_Media_18Mo = Yes: Innovator {Late Majority=0, Innovator=1, Early Adopter=1, Early Majority=0}
|   |   |   |   |   |   |   |   |   |   |   Age ≤ 29.500: Late Majority {Late Majority=1, Innovator=0, Early Adopter=1, Early Majority=0}
|   |   |   |   |   |   |   |   |   Age ≤ 28
|   |   |   |   |   |   |   |   |   |   Payment_Method = Bank Transfer: Innovator {Late Majority=0, Innovator=4, Early Adopter=0, Early Majority=1}
|   |   |   |   |   |   |   |   |   |   Payment_Method = Credit Card: Innovator {Late Majority=0, Innovator=4, Early Adopter=1, Early Majority=0}
|   |   |   |   |   |   |   |   |   |   Payment_Method = Website Account: Early Adopter {Late Majority=0, Innovator=1, Early Adopter=7, Early Majority=1}
|   |   |   |   |   |   |   Bought_Digital_Books = Yes: Innovator {Late Majority=2, Innovator=38, Early Adopter=21, Early Majority=5}
|   |   |   |   |   Age ≤ 21.500
|   |   |   |   |   |   Bought_Digital_Books = No: Early Adopter {Late Majority=0, Innovator=0, Early Adopter=10, Early Majority=0}
|   |   |   |   |   |   Bought_Digital_Books = Yes: Innovator {Late Majority=0, Innovator=1, Early Adopter=1, Early Majority=0}
Website_Activity = Seldom
|   Bought_Digital_Books = No
|   |   Age > 25.500: Late Majority {Late Majority=142, Innovator=4, Early Adopter=10, Early Majority=33}
|   |   Age ≤ 25.500: Early Majority {Late Majority=3, Innovator=1, Early Adopter=0, Early Majority=32}
|   Bought_Digital_Books = Yes
|   |   Age > 64.500: Early Majority {Late Majority=0, Innovator=0, Early Adopter=0, Early Majority=3}
|   |   Age ≤ 64.500
|   |   |   Age > 63.500
|   |   |   |   Marital_Status = M: Late Majority {Late Majority=2, Innovator=0, Early Adopter=0, Early Majority=0}
|   |   |   |   Marital_Status = S: Early Adopter {Late Majority=2, Innovator=0, Early Adopter=3, Early Majority=0}
|   |   |   Age ≤ 63.500
|   |   |   |   Age > 23.500: Early Adopter {Late Majority=10, Innovator=6, Early Adopter=77, Early Majority=66}
|   |   |   |   Age ≤ 23.500
|   |   |   |   |   Bought_Digital_Media_18Mo = No: Early Adopter {Late Majority=0, Innovator=0, Early Adopter=6, Early Majority=0}
|   |   |   |   |   Bought_Digital_Media_18Mo = Yes
|   |   |   |   |   |   Payment_Method = Bank Transfer
|   |   |   |   |   |   |   Gender = F: Innovator {Late Majority=0, Innovator=3, Early Adopter=0, Early Majority=0}
|   |   |   |   |   |   |   Gender = M
|   |   |   |   |   |   |   |   Age > 18: Early Adopter {Late Majority=0, Innovator=0, Early Adopter=4, Early Majority=0}
|   |   |   |   |   |   |   |   Age ≤ 18: Innovator {Late Majority=0, Innovator=1, Early Adopter=1, Early Majority=0}
|   |   |   |   |   |   Payment_Method = Credit Card: Early Adopter {Late Majority=0, Innovator=0, Early Adopter=2, Early Majority=0}
|   |   |   |   |   |   Payment_Method = Monthly Billing: Early Adopter {Late Majority=0, Innovator=0, Early Adopter=1, Early Majority=1}
|   |   |   |   |   |   Payment_Method = Website Account
|   |   |   |   |   |   |   Bought_Electronics_12Mo = No: Early Adopter {Late Majority=0, Innovator=0, Early Adopter=5, Early Majority=0}
|   |   |   |   |   |   |   Bought_Electronics_12Mo = Yes
|   |   |   |   |   |   |   |   Gender = F
|   |   |   |   |   |   |   |   |   Age > 22: Early Adopter {Late Majority=0, Innovator=0, Early Adopter=1, Early Majority=1}
|   |   |   |   |   |   |   |   |   Age ≤ 22: Innovator {Late Majority=0, Innovator=2, Early Adopter=0, Early Majority=0}
|   |   |   |   |   |   |   |   Gender = M: Early Adopter {Late Majority=0, Innovator=0, Early Adopter=1, Early Majority=1}

the text above are the description of the decision tree.



as we can see from the the picture above, the amount of value late majority is (168), early adopter (166), innovator (77), and early majority (62). from the data we could determine which type
is being the least and which type is the being most. and here are some more result that are gained from the decision tree model.


Komentar

Posting Komentar

Postingan populer dari blog ini

 Application of ICT use in schools in Nigeria  The adoption and use of ICTs in schools have a positive impact on teaching, learning, and research. Despite the roles ICTs can play in education, secondary schools in Nigeria have yet to extensively adopt them for teaching and learning. Efforts geared towards integration of ICTs into the secondary school system, have not had much impact. Problems such as poor policy and project implementation strategies, and limited or poor information infrastructure militate against these efforts. In order to ensure that ICTs are widely adopted and used in Nigeria's secondary school system, the following efforts should be taken. Government should ensure that ICT policy statements are translated into reality. An ICT policy implementation commission should be created. This commission should be funded and given the power to provide ICT facilities in the schools and monitor their use. All secondary schools should be made beneficiarie
Baca selengkapnya

assignment 6 comparison of all 4 method

Decision tree C4.5 C4.5 is an algorithm used to generate a decision tree developed by Ross Quinlan. C4.5 is an extension of Quinlan's earlier ID3 algorithm. The decision trees generated by C4.5 can be used for classification, and for this reason, C4.5 is often referred to as a statistical classifier. Authors of the Weka machine learning software described the C4.5 algorithm as "a landmark decision tree program that is probably the machine learning workhorse most widely used in practice to date". advantages: •  Build models that could easily interpreted •  Easy to implement •  It can use categorical and continuous values •  Deals with noise disadvantages: •   Small variation in data can lead to different decision trees (especially when the variables are close to each other in value) •  Does not work very well on a small training set Naive Bayes In machine learning, naive Bayes classifiers are a family of simple probabilistic classifiers based on
Baca selengkapnya

Assignment 1 Big Data and Data Analytics

Gambar
                                            Big data implementation in the banking industries ·        Objective The financial industry is one of the most data driven of industries. At the end of 2012. It was estimated that financial and securities organisation were managing 3.8 petabytes of data per firm. Data sets have grown immensely in terms of size, type and complexity and are difficult to work on using traditional database management tools. Many large financial and banking institution are reaching the upper limits of their legacy system and are now seeking fresh analytics and framework solution ·        Problems Regulators are demanding greater transparency, customers want a more relevant and personalized experience, and CEOs are looking for sustainable growth opportunities. A common thread in all of these issues is data. Big data. What is big data? Forrester puts it succinctly in saying “big data encompasses techniques and technologies that make capturing value fr
Baca selengkapnya