[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-160319-en":3,"doc-seo-160319-105":30,"detail-sidebar-cat-0-en-105":90},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":4,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":27,"seo_description":14,"update_tm":28,"read_time":29},160319,7971461741311,"Ophelia","https://ap-avatar.wpscdn.com/avatar/74000253aff267980c6?x-image-process=image/resize,m_fixed,w_180,h_180&k=1779345379180704826",4,"Exam","CSCC11H - Machine Learning and Data Mining - December 2014 University of Toronto at Scarborough Exam","December 2014 CSCC11H exam (University of Toronto at Scarborough) for Machine Learning and Data Mining, Duration 3 hours with no aids allowed. The paper assesses core concepts in ensemble learning, Naive Bayes assumptions, K-fold cross-validation, gradient descent variants, expected loss in stochastic optimization, and probability rules leading to Bayes’ Rule. It also evaluates basis function regression using likelihood and closed-form solutions, Bayesian weight posteriors with Gaussian priors, supervised classification model choice and decision boundaries, and PCA including objective functions and algorithmic steps.","UNIVERSITY OF TORONTO AT SCARBOROUGH Department of Computer and Mathematical Sciences  \nDECEMBER 2014 EXAMINATIONS  \nCSCC11H: Machine Learning and Data Mining  \nDuration: 3 hours  \nAids allowed: None  \nThere are 16 pages total (including this page)  \nPlease answer questions on the exam pages in the space provided. You may use the back of the pages for scratch work but final answers should be in the provided spaces. Read questions carefully and answer as neatly, clearly and concisely as possible; illegible or incomprehensible answers will get no marks. Should a question be unclear or ambiguous, make a reasonable interpretation and state what you have assumed before answering. Partial credit will be given for clear formulations of how to solve the problems.  \nFamily name:    \nGiven names:    \nStudent number:    \nSignature :    \nBy signing above, I certify that the work contained within is my work and my work alone and understand that copying another students work or allowing another student to copy my work is a serious academic offence.  \nQuestion Marks  \n1  / 23 2  / 15 3  / 12 4  / 20 5  / 21  \n6  / 9 Bonus   Total  / 100  \n1 Short Answer [23 marks]  \n(a) [2 marks] Ensemble methods combine together many simple, poorly performing classifiersin order to produce a single, high quality classifier. Name two ensemble methods.  \n(b) [2 marks] What is the principal assumption in the Naive Bayes' model, and when is this assumption useful?  \n(c) [4 marks] Describe the K-fold cross-validation algorithm for model selection.  \nQuestion 1 continued.  \n(d) [1 marks] Gradient Descent and Stochastic Gradient Descent are very similar in that they both iteratively update the parameter vector based on the gradient of a function. Describe either in words how they different.  \n(e) [2 marks] Stochastic Gradient Descent is motivated by the idea that there exists (in the universe) an infinite amount of data which is distributed according to p(x; y) . Then, given some parameters 􀀒 and a loss function L (x; yj􀀒) we wish to minimize the expected loss. Define mathematically the expected loss.  \nQuestion 1 continued.  \n(f) [6 marks] In class we discussed three different kinds of Unsupervised Learning problems. List the three types of problems and for each name a method which addresses that problem.  \n(g) [3 marks] What is the Product Rule of probability? Define it and use it to derive Bayes' Rule.  \n(h) [3 marks] Use Bayes' Rule to write the probability of the parameters 􀀒 given the data D. Specify which elements correspond to the posterior, the likelihood, the prior and the evidence.  \n2 Basis Function Regression [15 marks]  \nSuppose you are given a dataset of N training pairs f (xi ; yi)g, such that xi 2 R; yi 2 R. We want to fit the following model to the data:  \nK  \ny = f (x) + n; where f (x) = Xwj sin(cx + dj) ; and n 􀀘 N (0 ; 1=􀀋) : (1)  \nj=1  \nModel parameters include the weights w = [w1 ; :::wK ]T , the frequency c, the phase shifts d =[dj :::dK ], and the variance 1=􀀋 .  \n(a) [2 marks] Provide an analytic expression for p(yj x; c; w; 􀀋; d) .  \n(b) [2 marks] Formulate the likelihood of the training data given this model, p(yj x; c; w; 􀀋; d) . Simplify where possible and include all terms and constants.  \n(c) [3 marks] Write the negative log-likelihood, and simplify as much as possible. Include all terms and constants. To simplify the remainder of the question, it is recommended that you write the summation in terms of a dot product (i.e., wTb) .  \nQuestion 2 continued.  \n(d) [4 marks] Suppose all parameters but w are known. Give a closed-form expression for the optimal weight vector w that maximizes the data likelihood.  \nQuestion 2 continued.  \n(e) [4 marks] Suppose we assume a Gaussian prior on the weights w 􀀘 N (0; 􀀌I) . Derive the posterior distribution over the weights w, given c, 􀀋, and d. What type of distribution is this posterior?  \n3 Classification [12 marks]  \nConsider the following classification algorithms: Gaussian Class Conditional, K-Nearest","cbCaio0p1vm16ie1","https://ap.wps.com/l/cbCaio0p1vm16ie1","pdf",138146,1,16,"English","en",105,"# CSCC11H: Machine Learning and Data Mining\n## Short Answer (1)\n## Basis Function Regression (2)\n## Classification (3)\n## PCA (4)","[{\"question\":\"What topics are covered in the Short Answer section of CSCC11H?\",\"answer\":\"It covers ensemble methods, Naive Bayes’ principal assumption, K-fold cross-validation, differences between gradient descent variants, expected loss in stochastic optimization, unsupervised learning problem types, and probability rules leading to Bayes’ Rule.\"},{\"question\":\"How does the Basis Function Regression question model the data and what are the key parameters?\",\"answer\":\"It models outputs as y = f(x) + n with f(x)=Σ wj sin(cx + dj) and noise n ~ N(0, 1/λ). Parameters include weights w, frequency c, phase shifts d, and noise variance 1/λ.\"},{\"question\":\"What does the PCA section ask students to demonstrate?\",\"answer\":\"It asks for the relationship between latent coordinates and observed data, the objective minimized to learn PCA parameters, distinctions between probabilistic PCA and regular PCA, and the steps of the PCA algorithm.\"}]","CSCC11H - Machine Learning and Data Mining - December 2014 University of Toronto at Scarborough Exam | PDF",1788053931,40,{"code":4,"msg":31,"data":32},"ok",{"site_id":24,"language":23,"slug":33,"title":13,"keywords":34,"description":14,"schema_data":35,"social_meta":85,"head_meta":87,"extra_data":89,"updated_unix":28},"cscc11h-machine-learning-and-data-mining-december-2014-university-of-toronto-at-scarborough-exam","",{"@graph":36,"@context":84},[37,53,67],{"@type":38,"itemListElement":39},"BreadcrumbList",[40,44,48,51],{"item":41,"name":42,"@type":43,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":45,"name":46,"@type":43,"position":47},"https://docshare.wps.com/document/","Document",2,{"item":49,"name":12,"@type":43,"position":50},"https://docshare.wps.com/document/exam/",3,{"item":52,"name":13,"@type":43,"position":11},"https://docshare.wps.com/document/cscc11h-machine-learning-and-data-mining-december-2014-university-of-toronto-at-scarborough-exam/160319/",{"url":52,"name":13,"@type":54,"author":55,"headline":13,"publisher":57,"fileFormat":60,"inLanguage":23,"description":14,"dateModified":61,"datePublished":61,"encodingFormat":60,"isAccessibleForFree":62,"interactionStatistic":63},"DigitalDocument",{"name":9,"@type":56},"Person",{"url":41,"name":58,"@type":59},"DocShare","Organization","application/pdf","2026-08-30",true,{"@type":64,"interactionType":65,"userInteractionCount":4},"InteractionCounter",{"@type":66},"ViewAction",{"@type":68,"mainEntity":69},"FAQPage",[70,76,80],{"name":71,"@type":72,"acceptedAnswer":73},"What topics are covered in the Short Answer section of CSCC11H?","Question",{"text":74,"@type":75},"It covers ensemble methods, Naive Bayes’ principal assumption, K-fold cross-validation, differences between gradient descent variants, expected loss in stochastic optimization, unsupervised learning problem types, and probability rules leading to Bayes’ Rule.","Answer",{"name":77,"@type":72,"acceptedAnswer":78},"How does the Basis Function Regression question model the data and what are the key parameters?",{"text":79,"@type":75},"It models outputs as y = f(x) + n with f(x)=Σ wj sin(cx + dj) and noise n ~ N(0, 1/λ). Parameters include weights w, frequency c, phase shifts d, and noise variance 1/λ.",{"name":81,"@type":72,"acceptedAnswer":82},"What does the PCA section ask students to demonstrate?",{"text":83,"@type":75},"It asks for the relationship between latent coordinates and observed data, the objective minimized to learn PCA parameters, distinctions between probabilistic PCA and regular PCA, and the steps of the PCA algorithm.","https://schema.org",{"og:url":52,"og:type":86,"og:title":13,"og:site_name":58,"og:description":14},"article",{"robots":88,"canonical":52},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":91},[92,96,100,103,108,113,117,122,127,130,134],{"id":20,"doc_module":4,"doc_module_name":46,"category_name":93,"show_sort_weight":94,"slug":95},"Story & Novel",90,"story-novel",{"id":47,"doc_module":4,"doc_module_name":46,"category_name":97,"show_sort_weight":98,"slug":99},"Literature",80,"literature",{"id":11,"doc_module":4,"doc_module_name":46,"category_name":12,"show_sort_weight":101,"slug":102},70,"exam",{"id":104,"doc_module":4,"doc_module_name":46,"category_name":105,"show_sort_weight":106,"slug":107},5,"Comic",60,"comic",{"id":109,"doc_module":4,"doc_module_name":46,"category_name":110,"show_sort_weight":111,"slug":112},6,"Technology",50,"technology",{"id":114,"doc_module":4,"doc_module_name":46,"category_name":115,"show_sort_weight":29,"slug":116},7,"Healthcare","healthcare",{"id":118,"doc_module":4,"doc_module_name":46,"category_name":119,"show_sort_weight":120,"slug":121},8,"Research & Report",30,"research-report",{"id":123,"doc_module":4,"doc_module_name":46,"category_name":124,"show_sort_weight":125,"slug":126},9,"Religion & Spirituality",20,"religion-spirituality",{"id":125,"doc_module":4,"doc_module_name":46,"category_name":128,"show_sort_weight":125,"slug":129},"World Cup","world-cup",{"id":131,"doc_module":4,"doc_module_name":46,"category_name":132,"show_sort_weight":131,"slug":133},10,"Lifestyle","lifestyle",{"id":135,"doc_module":4,"doc_module_name":46,"category_name":136,"show_sort_weight":104,"slug":137},19,"General","general"]