[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"detail-sidebar-cat-1-en-105":3,"doc-seo-572369-105":53,"doc-detail-572369-en":127},{"code":4,"msg":5,"data":6},0,"success",[7,14,19,24,29,34,39,44,49],{"id":8,"doc_module":9,"doc_module_name":10,"category_name":11,"show_sort_weight":12,"slug":13},11,1,"Template","Presentations",90,"presentations",{"id":15,"doc_module":9,"doc_module_name":10,"category_name":16,"show_sort_weight":17,"slug":18},12,"Resumes",80,"resumes",{"id":20,"doc_module":9,"doc_module_name":10,"category_name":21,"show_sort_weight":22,"slug":23},14,"Invoices",70,"invoices",{"id":25,"doc_module":9,"doc_module_name":10,"category_name":26,"show_sort_weight":27,"slug":28},15,"Posters",60,"posters",{"id":30,"doc_module":9,"doc_module_name":10,"category_name":31,"show_sort_weight":32,"slug":33},16,"Social Media",50,"social-media",{"id":35,"doc_module":9,"doc_module_name":10,"category_name":36,"show_sort_weight":37,"slug":38},17,"Forms",40,"forms",{"id":40,"doc_module":9,"doc_module_name":10,"category_name":41,"show_sort_weight":42,"slug":43},18,"Letters",30,"letters",{"id":45,"doc_module":9,"doc_module_name":10,"category_name":46,"show_sort_weight":47,"slug":48},21,"Paper Templates",5,"papers-templates",{"id":50,"doc_module":9,"doc_module_name":10,"category_name":51,"show_sort_weight":4,"slug":52},158,"General","general-158",{"code":4,"msg":54,"data":55},"ok",{"site_id":56,"language":57,"slug":58,"title":59,"keywords":60,"description":61,"schema_data":62,"social_meta":120,"head_meta":122,"extra_data":124,"updated_unix":126},105,"en","linear-algebra-review-and-reference-september-30-2015-study-notes","Linear Algebra Review and Reference - September 30, 2015 - study notes","","Linear Algebra Review and Reference consolidates essential tools for modeling and solving systems of linear equations in compact matrix form. It introduces notation for matrices, vectors, indexing, columns and rows, then develops matrix multiplication through vector-vector, matrix-vector, and matrix-matrix products, including inner and outer products. Subsequent sections cover key matrix operations and properties (identity, transpose, symmetric matrices, trace, norms, rank, inverse, orthogonal matrices, range and nullspace, determinant, quadratic forms, eigenvalues/eigenvectors) and extend to matrix calculus with gradients, Hessians, least squares, determinant gradients, and optimization links via eigenvalues.",{"@graph":63,"@context":119},[64,80,102],{"@type":65,"itemListElement":66},"BreadcrumbList",[67,71,74,77],{"item":68,"name":69,"@type":70,"position":9},"https://docshare.wps.com","Home","ListItem",{"item":72,"name":10,"@type":70,"position":73},"https://docshare.wps.com/template/",2,{"item":75,"name":51,"@type":70,"position":76},"https://docshare.wps.com/template/general/",3,{"item":78,"name":59,"@type":70,"position":79},"https://docshare.wps.com/template/linear-algebra-review-and-reference-september-30-2015-study-notes/572369/",4,{"url":78,"name":59,"@type":81,"image":82,"author":87,"headline":59,"publisher":90,"fileFormat":93,"inLanguage":57,"description":61,"dateModified":94,"datePublished":95,"encodingFormat":93,"isAccessibleForFree":96,"interactionStatistic":97},"DigitalDocument",{"url":83,"@type":84,"width":85,"height":86},"https://docshare.wps.com/thumbnails/linear-algebra-review-and-reference-september-30-2015-study-notes/572369.png","ImageObject",442,249,{"name":88,"@type":89},"Rizky","Person",{"url":68,"name":91,"@type":92},"DocShare","Organization","application/pdf","2026-10-22","2026-10-13",true,{"@type":98,"interactionType":99,"userInteractionCount":101},"InteractionCounter",{"@type":100},"ViewAction",8,{"@type":103,"mainEntity":104},"FAQPage",[105,111,115],{"name":106,"@type":107,"acceptedAnswer":108},"What problem does the document address when using matrix notation like Ax = b?","Question",{"text":109,"@type":110},"It presents linear equations in compact matrix form, enabling analysis of solvability and solutions for systems of variables.","Answer",{"name":112,"@type":107,"acceptedAnswer":113},"How does the document define matrix multiplication and when does the product exist?",{"text":114,"@type":110},"It defines C = AB with dimensions determined by A ∈ R^{m×n} and B ∈ R^{n×p}, and states the product exists when the number of columns in A matches the number of rows in B.",{"name":116,"@type":107,"acceptedAnswer":117},"What are inner and outer products in this review?",{"text":118,"@type":110},"It treats x^T y as an inner (dot) product producing a scalar, and x y^T as an outer product producing a matrix with entries (xy^T)_{ij} = x_i y_j.","https://schema.org",{"og:url":78,"og:type":121,"og:title":59,"og:site_name":91,"og:description":61},"article",{"robots":123,"canonical":78},"index,follow",{"doc_id":125,"site_id":56},572369,1792012885,{"code":4,"msg":5,"data":128},{"doc_id":125,"user_id":129,"nickname":88,"user_avatar":130,"doc_module":9,"category_id":50,"category_name":51,"doc_title":59,"doc_description":61,"doc_content":131,"file_id":132,"file_url":133,"file_type":134,"file_size":135,"view_count":101,"is_deleted":4,"is_public":9,"is_downloadable":9,"audit_status":9,"page_count":136,"language":137,"language_code":57,"site_id":56,"html_lang":57,"table_of_contents":138,"faqs":139,"seo_title":140,"seo_description":61,"update_tm":141,"read_time":142},962085564807,"https://ap-avatar.wpscdn.com/davatar_6f874abed73319feea01a86fa6f0fab8","Linear Algebra Review and Reference  \nZico Kolter (updated by Chuong Do)  \nSeptember 30, 2015  \nContents  \n1 Basic Concepts and Notation 2  \n1.1 Basic Notation .................................. 2  \n2 Matrix Multiplication 3  \n2.1 Vector-Vector Products .............................. 4  \n2.2 Matrix-Vector Products ............................. 4  \n2.3 Matrix-Matrix Products ............................. 5  \n3 Operations and Properties 7  \n3.1 The Identity Matrix and Diagonal Matrices .................. 8  \n3.2 The Transpose .................................. 8  \n3.3 Symmetric Matrices ................................ 8  \n3.4 The Trace ..................................... 9  \n3.5 Norms ....................................... 10  \n3.6 Linear Independence and Rank ......................... 11  \n3.7 The Inverse .................................... 11  \n3.8 Orthogonal Matrices ............................... 12  \n3.9 Range and Nullspace of a Matrix ........................ 12  \n3.10 The Determinant ................................. 14  \n3.11 Quadratic Forms and Positive Semide􀀌nite Matrices .............. 17  \n3.12 Eigenvalues and Eigenvectors .......................... 18  \n3.13 Eigenvalues and Eigenvectors of Symmetric Matrices ............. 19  \n4 Matrix Calculus 20  \n4.1 The Gradient ................................... 20  \n4.2 The Hessian .................................... 22  \n4.3 Gradients and Hessians of Quadratic and Linear Functions .......... 23  \n4.4 Least Squares ................................... 25  \n4.5 Gradients of the Determinant .......................... 25  \n4.6 Eigenvalues as Optimization ........................... 26  \n1 Basic Concepts and Notation  \nLinear algebra provides a way of compactly representing and operating on sets of linear equations. For example, consider the following system of equations:  \n4x1 − 5x2 = −13 −2x1 + 3x2 = 9 .  \nThis is two equations and two variables, so as you know from high school algebra, you can 􀀌nd a unique solution for x1 and x2 (unless the equations are somehow degenerate, for example if the second equation is simply a multiple of the 􀀌rst, but in the case above thereis in fact a unique solution) . In matrix notation, we can write the system more compactly as  \nAx = b  \nwith  \nA = 􀀔 2 5 􀀕 , b = 􀀔 −139 􀀕 .  \nAs we will see shortly, there are many advantages (including the obvious space savings) to analyzing linear equations in this form.  \n1.1 Basic Notation We use the following notation:  \n• By A ∈ Rm×n we denote a matrix with m rows and n columns, where the entries of Aare real numbers.  \n• By x ∈ Rn , we denote a vector with n entries. By convention, an n-dimensional vector is often thought of as a matrix with n rows and 1 column, known as a column vector. If we want to explicitly represent a row vector—a matrix with 1 row and n columns  \n— we typically write xT (here xT denotes the transpose of x, which we will de􀀌ne shortly) .  \n• The ith element of a vector x is denoted xi:  \n􀀲  \n􀀶  \nx = 􀀶  \n􀀶  \n􀀴  \nx1  \nx2  \n.  \n.  \n.  \nxn  \n􀀳  \n􀀷  \n􀀷 .  \n􀀷  \n􀀵  \n• We use the notation aij (or Aij , Ai,j , etc) to denote the entry of A in the ith row and  \njth column:  \nA =  \n􀀲  \n􀀶  \n􀀶  \n􀀶  \n􀀴  \na11  \na21  \n.  \n.  \n.  \nam1  \na12  \na22  \n.  \n.  \n.  \nam2  \n· · · a1n  \n· · · a2n  \n..  \n. .  \n.  \n.  \n· · · amn  \n􀀳  \n􀀷  \n􀀷 .  \n􀀷  \n􀀵  \n• We denote the jth column of A by aj or A:,j:  \nA = 􀀲 a| a| · · · a| 􀀳  \n􀀴 | 1 | 2 |n 􀀵 .  \n• We denote the ith row of A by aTi or Ai,::  \n􀀲  \n􀀶  \nA = 􀀶  \n􀀶  \n􀀴  \n—  \n—  \n—  \naT1 —  \naT2 —.  \n.  \n.  \naTm —  \n􀀳  \n􀀷  \n􀀷 .  \n􀀷  \n􀀵  \n• Note that these de􀀌nitions are ambiguous (for example, the a1 and aT1 in the previous two de􀀌nitions are not the same vector) . Usually the meaning of the notation should be obvious from its use.  \n2 Matrix Multiplication  \nThe product of two matrices A ∈ Rm×n and B ∈ Rn×p is the matrix  \nC = AB ∈ Rm×p ,  \nwhere  \nn  \nCij =X AikBkj .  \nk=1  \nNote that in order for the matrix product to exist, the number of columns in A must eq","cbCaig5RkEF1iiO5","https://ap.wps.com/l/cbCaig5RkEF1iiO5","pdf",205269,26,"English","# Contents\n## Basic Concepts and Notation\n## Matrix Multiplication\n## Operations and Properties\n## Matrix Calculus","[{\"question\":\"What problem does the document address when using matrix notation like Ax = b?\",\"answer\":\"It presents linear equations in compact matrix form, enabling analysis of solvability and solutions for systems of variables.\"},{\"question\":\"How does the document define matrix multiplication and when does the product exist?\",\"answer\":\"It defines C = AB with dimensions determined by A ∈ R^{m×n} and B ∈ R^{n×p}, and states the product exists when the number of columns in A matches the number of rows in B.\"},{\"question\":\"What are inner and outer products in this review?\",\"answer\":\"It treats x^T y as an inner (dot) product producing a scalar, and x y^T as an outer product producing a matrix with entries (xy^T)_{ij} = x_i y_j.\"}]","Linear Algebra Review and Reference - September 30, 2015 - study notes | PDF",1791926991,9]