[{"data":1,"prerenderedAt":22970},["ShallowReactive",2],{"blog-post-workflow-machine-learning-projects-en":3,"blog-post-adjacent-workflow-machine-learning-projects-en":1878},{"id":4,"title":5,"author":6,"body":7,"date":1858,"description":13,"extension":1859,"image":1860,"lastmod":1858,"meta":1861,"navigation":1862,"order":1863,"path":1864,"seo":1865,"sitemap":1866,"slug":1869,"stem":1870,"summary":1871,"tags":1872,"__hash__":1877},"content_en\u002Fblog\u002Fblog\u002Fworkflow-machine-learning-projects.md","The workflow in Machine Learning projects","David Deras",{"type":8,"value":9,"toc":1819},"minimark",[10,14,24,27,30,33,62,77,88,90,95,98,124,127,130,152,154,158,161,187,190,194,197,200,204,207,263,266,292,298,303,329,333,336,362,365,369,427,431,439,442,452,460,466,474,480,488,492,495,521,529,535,538,542,545,584,587,591,594,611,613,619,623,648,652,655,657,671,675,678,695,698,702,705,708,711,731,736,739,777,781,784,828,832,835,883,887,890,894,897,901,904,936,940,943,963,966,1004,1007,1040,1043,1069,1071,1075,1078,1083,1086,1111,1114,1120,1123,1129,1136,1142,1149,1153,1159,1162,1168,1174,1180,1187,1190,1197,1200,1206,1209,1213,1216,1223,1229,1236,1242,1246,1249,1255,1258,1264,1270,1274,1277,1284,1287,1293,1300,1303,1309,1316,1319,1325,1328,1332,1335,1378,1381,1387,1394,1398,1401,1412,1415,1474,1480,1491,1498,1502,1505,1516,1519,1522,1525,1528,1536,1539,1601,1604,1607,1610,1652,1655,1712,1715,1719,1722,1736,1739,1743,1746,1749,1752,1760,1766,1769,1772,1780,1782,1789,1800,1803,1810,1817],[11,12,13],"p",{},"We continue learning about the world of machine learning, and this time, we will delve into the typical flow of a machine learning project.",[11,15,16,17],{},"Previous article: ",[18,19,23],"a",{"href":20,"rel":21},"https:\u002F\u002Fderas.dev\u002Fblog\u002Fmachine-learning-paradigms-and-mathematical-foundations",[22],"nofollow","Paradigms of machine learning and mathematical foundations",[25,26],"table-of-contents",{},[28,29],"hr",{},[11,31,32],{},"Why is it important to understand the workflow of a machine learning project?",[34,35,36,44,50,56],"ul",{},[37,38,39,43],"li",{},[40,41,42],"strong",{},"The process is more important than the result",": Successful models do not depend solely on sophisticated algorithms, but on a well-structured process. A Random Forest with clean and well-prepared data consistently outperforms a deep neural network with poor-quality data.",[37,45,46,49],{},[40,47,48],{},"Reproducibility",": A clear and documented workflow allows other data scientists to reproduce your results, which is fundamental for validation and advancing knowledge in the field.",[37,51,52,55],{},[40,53,54],{},"Collaboration",": In machine learning projects, there are often multiple people involved, from data scientists to data engineers and stakeholders. A well-defined workflow facilitates communication and collaboration among all team members.",[37,57,58,61],{},[40,59,60],{},"Reduces the risk of errors",": A structured process helps identify and correct errors in the early stages of the project, which can save time and resources in the long run.",[11,63,64,65,68,69,72,73,76],{},"In general, machine learning is a process that is ",[40,66,67],{},"part of a system",", with an ",[40,70,71],{},"iterative cycle"," and ",[40,74,75],{},"value-driven approach"," that consists of several stages, each with their own tasks and challenges.",[11,78,79,84],{},[80,81],"img",{"alt":82,"src":83},"Integrated View of the Machine Learning Cycle","\u002Fblog\u002Fworkflow-machine-learning-projects\u002Fshared\u002Fmachine-learning-cycle.webp",[85,86,87],"em",{},"Machine Learning Cycle",[28,89],{},[91,92,94],"h2",{"id":93},"_1-problem-definition","1. Problem Definition",[11,96,97],{},"The first stage of any machine learning project is the problem definition:",[34,99,100,106,112,118],{},[37,101,102,105],{},[40,103,104],{},"Problem Identification",": What do we want to achieve with the project? What decisions do we want to support with the model? It is crucial to understand the business context or application to clearly define the problem.",[37,107,108,111],{},[40,109,110],{},"Target Variable",": What is the variable we want to predict or classify? This variable, also known as the dependent variable, is the focus of the project and must be clearly defined.",[37,113,114,117],{},[40,115,116],{},"Type of Problem",": Is it a classification, regression, clustering, or something else? The nature of the problem will influence the choice of algorithms and techniques to use.",[37,119,120,123],{},[40,121,122],{},"Evaluation Metrics",": How will we measure the success of the model? It is important to define evaluation metrics from the beginning, as these will guide the model development and decision-making throughout the project.",[11,125,126],{},"This stage is the foundation of the entire project. A poorly defined problem can lead to wasted efforts and unsatisfactory results. It is fundamental to dedicate time to understanding the problem and setting clear objectives before moving on to subsequent stages.",[11,128,129],{},"Let's look at a practical example:\nSuppose an e-commerce company wants to predict whether a customer will make a purchase on their website. In this case:",[34,131,132,137,142,147],{},[37,133,134,136],{},[40,135,104],{},": Predicting the probability of a customer making a purchase.",[37,138,139,141],{},[40,140,110],{},": The target variable could be a binary variable indicating whether the customer made a purchase (1) or not (0).",[37,143,144,146],{},[40,145,116],{},": This is a binary classification problem.",[37,148,149,151],{},[40,150,122],{},": The evaluation metrics could include accuracy, recall, and F1-score, depending on the relative importance of false positives and false negatives in the business context.",[28,153],{},[91,155,157],{"id":156},"_2-data-collection","2. Data Collection",[11,159,160],{},"Once the problem is clearly defined, the next step is data collection, where relevant data sources must be identified and accessed. This can include:",[34,162,163,169,175,181],{},[37,164,165,168],{},[40,166,167],{},"Internal\u002FEnterprise Databases",": Data stored in internal company systems, such as relational databases, data warehouses or data lakes. Some examples include sales records, customer data, data from CRM or ERP systems, among others.",[37,170,171,174],{},[40,172,173],{},"APIs and Web Services",": External data from data providers, social media, geolocation services, etc. For example, a sentiment analysis company could use the Twitter API to collect tweets related to a specific topic.",[37,176,177,180],{},[40,178,179],{},"System Logs and Event Records",": Data generated by applications, servers, IoT devices, etc. For example, an infrastructure monitoring company could collect server logs to detect failure patterns.",[37,182,183,186],{},[40,184,185],{},"Public\u002FExternal Data",": Data available publicly, such as datasets from Kaggle, government data, academic research data, etc. For example, a researcher could use the MNIST image dataset to train a handwritten digit recognition model.",[11,188,189],{},"It is important to note that the quality of the collected data is crucial for the success of the project. The data must be relevant, complete, accurate and up-to-date. Additionally, it is fundamental to consider ethical and legal aspects related to data collection and usage, such as user privacy and compliance with regulations like GDPR.",[91,191,193],{"id":192},"_3-data-preprocessing","3. Data Preprocessing",[11,195,196],{},"This is the phase of preparation and cleaning of data, which is a crucial step and often the biggest bottleneck. Data professionals usually dedicate between 70% and 80% of their time to preparing data and not to building models.",[11,198,199],{},"The quality of the models depends directly on the quality of the data; if the data is disorganized or incomplete, the model will not be able to learn useful patterns. Even the most sophisticated algorithm cannot compensate for poor-quality data.",[91,201,203],{"id":202},"_4-exploratory-data-analysis-eda","4. Exploratory Data Analysis (EDA)",[11,205,206],{},"During this stage, a detailed analysis of the data is performed to understand its structure, distribution, and relationships between variables. This includes:",[34,208,209,229,246],{},[37,210,211,214,215],{},[40,212,213],{},"Univariate Analysis",": Examining the distribution of each variable individually, using descriptive statistics and visualizations such as:\n",[34,216,217,220,223,226],{},[37,218,219],{},"Histograms",[37,221,222],{},"Boxplots",[37,224,225],{},"Bar Charts",[37,227,228],{},"Measures of central tendency (mean, median) and dispersion (standard deviation, interquartile range)",[37,230,231,234,235],{},[40,232,233],{},"Bivariate Analysis",": Exploring the relationships between pairs of variables, using visualizations such as:\n",[34,236,237,240,243],{},[37,238,239],{},"Scatter Plots",[37,241,242],{},"Heatmaps for visualizing correlations",[37,244,245],{},"Stacked Bar Charts for categorical variables",[37,247,248,251,252],{},[40,249,250],{},"Multivariate Analysis",": Examining the relationships between multiple variables simultaneously, utilizing techniques such as:\n",[34,253,254,257,260],{},[37,255,256],{},"Principal Component Analysis (PCA)",[37,258,259],{},"Cluster Analysis",[37,261,262],{},"Pair Plots\nThe EDA is fundamental for detecting problems in the data, such as outliers, skewed distributions or non-linear relationships between variables. Additionally, the EDA can provide valuable insights that will guide the feature selection and algorithm choice in the subsequent stages of the project.",[11,264,265],{},"The common tools for performing EDA include:",[34,267,268,274,280,286],{},[37,269,270,273],{},[40,271,272],{},"Python",": Bibliotecas como Pandas, Matplotlib, Seaborn y Plotly son ampliamente utilizadas para el análisis exploratorio de datos en Python.",[37,275,276,279],{},[40,277,278],{},"R",": Paquetes como ggplot2, dplyr y tidyr son populares para realizar EDA en R.",[37,281,282,285],{},[40,283,284],{},"Herramientas de visualización",": Herramientas como Tableau, Power BI o QlikView también pueden ser utilizadas para realizar análisis exploratorio de datos de manera interactiva.",[37,287,288,291],{},[40,289,290],{},"Jupyter Notebooks",": Los notebooks de Jupyter son una herramienta común para realizar EDA, ya que permiten combinar código, visualizaciones y texto explicativo en un solo documento.",[293,294,295],"blockquote",{},[11,296,297],{},"The EDA is not a linear step, often it is performed iteratively as new insights are discovered or problems in the data are identified. It is important to document the findings of the EDA, as these can be useful for decision-making in the subsequent stages of the project.",[299,300,302],"h3",{"id":301},"principles-for-effective-eda","Principles for Effective EDA",[34,304,305,311,317,323],{},[37,306,307,310],{},[40,308,309],{},"Start Simple",": Begin with basic visualizations and statistics to gain a general understanding of the data before diving into more complex analyses.",[37,312,313,316],{},[40,314,315],{},"Purposeful Use of Colors",": Use colors strategically to highlight important patterns or differences in the data, avoiding excessive use of colors that might be distracting.",[37,318,319,322],{},[40,320,321],{},"Iterative Process",": Continuously iterate as new insights are discovered or problems in the data are identified, adjusting the EDA approach as needed.",[37,324,325,328],{},[40,326,327],{},"Document Findings",": Record the insights and discoveries from the EDA to facilitate decision-making in subsequent stages of the project and to share with other team members.",[91,330,332],{"id":331},"_5-feature-engineering","5. Feature engineering",[11,334,335],{},"The feature engineering is the process of creating new features from the original data to improve the model's performance. It is the bridge between raw unstructured data and inputs ready for modeling. This stage is crucial because it helps us:",[34,337,338,344,350,356],{},[37,339,340,343],{},[40,341,342],{},"Improve Accuracy",": Well-designed features can capture complex patterns in the data that models can leverage to make better predictions.",[37,345,346,349],{},[40,347,348],{},"Reduce Overfitting",": By creating more relevant features, we can help models generalize better to unseen data, reducing the risk of overfitting.",[37,351,352,355],{},[40,353,354],{},"Facilitate Interpretation",": Well-designed features can make models more interpretable, which is especially important in applications where explainability is crucial.",[37,357,358,361],{},[40,359,360],{},"Increase Efficiency",": By reducing the dimensionality of the data or creating more informative features, we can improve the efficiency of model training.",[11,363,364],{},"Some fundamental techniques for feature engineering include:",[299,366,368],{"id":367},"numerical-transformations","Numerical Transformations",[34,370,371,392],{},[37,372,373,376,377],{},[40,374,375],{},"Scaling",": Useful for models sensitive to magnitude (Regression, SVM, KNN, neural networks).",[34,378,379,386,389],{},[37,380,381,382],{},"Min-Max Scaling: Maps values to range ",[383,384,385],"span",{},"0,1",[37,387,388],{},"Standardization (Z-score): Mean 0, standard deviation 1",[37,390,391],{},"Robust Scaling: Uses median and interquartile range (better with outliers)",[37,393,394,397,398],{},[40,395,396],{},"Non-linear Transformations",": When the relationship is not linear.",[34,399,400,407,413,424],{},[37,401,402,403],{},"Log transform: ",[404,405,406],"code",{},"log(x)",[37,408,409,410],{},"Square root: ",[404,411,412],{},"sqrt(x)",[37,414,415,416,419,420,423],{},"Box-Cox: ",[404,417,418],{},"((x + 1)^λ - 1) \u002F λ"," (for λ ≠ 0) or ",[404,421,422],{},"log(x + 1)"," (for λ = 0)",[37,425,426],{},"Yeo-Johnson: Similar to Box-Cox but for data with negative values\nVery useful when there are highly skewed distributions.",[299,428,430],{"id":429},"categorical-variables","Categorical Variables",[34,432,433],{},[37,434,435,438],{},[40,436,437],{},"One-Hot Encoding",": Converts categories into binary columns.",[11,440,441],{},"Example:",[443,444,449],"pre",{"className":445,"code":447,"language":448},[446],"language-text","Color: [Red, Blue, Green]\n\nBecome:\n\nRed  Blue  Green\n1     0     0\n","text",[404,450,447],{"__ignoreMap":451},"",[34,453,454],{},[37,455,456,459],{},[40,457,458],{},"Ordinal Encoding",": When there is an order:",[443,461,464],{"className":462,"code":463,"language":448},[446],"Low \u003C Medium \u003C High\n",[404,465,463],{"__ignoreMap":451},[34,467,468],{},[37,469,470,473],{},[40,471,472],{},"Target Encoding",": Replaces category with average of the target:",[443,475,478],{"className":476,"code":477,"language":448},[446],"City → average sales\n",[404,479,477],{"__ignoreMap":451},[34,481,482],{},[37,483,484,487],{},[40,485,486],{},"Frequency Encoding",": Replaces category with its frequency of occurrence.",[299,489,491],{"id":490},"temporal-features","Temporal Features",[11,493,494],{},"When working with dates, we can extract features such as:",[34,496,497,500,503,506,509,512,515,518],{},[37,498,499],{},"Year",[37,501,502],{},"Month",[37,504,505],{},"Day",[37,507,508],{},"Day of the week",[37,510,511],{},"Is weekend",[37,513,514],{},"Quarter",[37,516,517],{},"Date difference",[37,519,520],{},"Time since last event",[34,522,523],{},[37,524,525,528],{},[40,526,527],{},"Cyclical Encoding",": For variables like hour or month:",[443,530,533],{"className":531,"code":532,"language":448},[446],"sin(2π * hour \u002F 24)\ncos(2π * hour \u002F 24)\n",[404,534,532],{"__ignoreMap":451},[11,536,537],{},"This prevents 23 and 0 from seeming \"far apart\".",[299,539,541],{"id":540},"interactions-between-variables","Interactions between Variables",[11,543,544],{},"Sometimes the combination matters more than the single variable.",[34,546,547,556,568,576],{},[37,548,549,552,553],{},[40,550,551],{},"Product of variables",": ",[404,554,555],{},"x1 * x2",[37,557,558,552,561,564,565],{},[40,559,560],{},"Polynomials",[404,562,563],{},"x^2",", ",[404,566,567],{},"x^3",[37,569,570,552,573],{},[40,571,572],{},"Ratios",[404,574,575],{},"price \u002F size",[37,577,578,552,581],{},[40,579,580],{},"Differences",[404,582,583],{},"payment_date - registration_date",[11,585,586],{},"Very useful in linear models.",[299,588,590],{"id":589},"binning-discretization","Binning (Discretization)",[11,592,593],{},"Convert numbers into categories:",[34,595,596,601,606],{},[37,597,598],{},[40,599,600],{},"Binning uniforme",[37,602,603],{},[40,604,605],{},"Binning por cuantiles",[37,607,608],{},[40,609,610],{},"Binning basado en negocio",[11,612,441],{},[443,614,617],{"className":615,"code":616,"language":448},[446],"Age → [0-18], [19-35], [36-60], 60+\n",[404,618,616],{"__ignoreMap":451},[299,620,622],{"id":621},"handling-outliers","Handling Outliers",[34,624,625,630,635,640],{},[37,626,627],{},[40,628,629],{},"Clipping",[37,631,632],{},[40,633,634],{},"Winsorizing",[37,636,637],{},[40,638,639],{},"Log transform",[37,641,642,552,645],{},[40,643,644],{},"Create binary feature",[404,646,647],{},"es_outlier",[299,649,651],{"id":650},"cluster-based-features","Cluster-Based Features",[11,653,654],{},"Very powerful in transactional datasets.",[11,656,441],{},[34,658,659,662,665,668],{},[37,660,661],{},"Average purchases per user",[37,663,664],{},"Number of orders",[37,666,667],{},"Time since last purchase",[37,669,670],{},"Historical maximum\u002Fminimum",[299,672,674],{"id":673},"feature-selection","Feature Selection",[11,676,677],{},"It's not all about creating - it's also about deleting.",[34,679,680,683,686,689,692],{},[37,681,682],{},"Correlation",[37,684,685],{},"Mutual information",[37,687,688],{},"RFE",[37,690,691],{},"Lasso (L1)",[37,693,694],{},"Feature importance (trees)",[11,696,697],{},"Feature engineering is one of the most valuable skills in data science, as it can make the difference between a mediocre model and an exceptional one.",[91,699,701],{"id":700},"_6-training-of-models","6. Training of Models",[11,703,704],{},"Once the data is prepared and the features are designed, the next step is to train a machine learning model.",[11,706,707],{},"In this stage, an appropriate machine learning algorithm is selected for the defined problem and adjusted to the training data. The training process involves feeding the model with data and allowing it to learn patterns and relationships to make predictions.",[11,709,710],{},"The first thing we must consider before starting is the division of the data (datasets) into training, validation, and test sets. This is crucial for evaluating the model's performance fairly and avoiding overfitting:",[34,712,713,719,725],{},[37,714,715,718],{},[40,716,717],{},"Training Set (70-80%)",": This is the set of data used to train the model. The model learns from these data, adjusting its parameters to minimize error in predictions.",[37,720,721,724],{},[40,722,723],{},"Validation Set (10-15%)",": This is a separate set of data used to tune the model's hyperparameters and make decisions about the model's architecture. The model is not directly trained on this data, but it is used to evaluate its performance during the training process.",[37,726,727,730],{},[40,728,729],{},"Test Set (10-15%)",": This is a completely separate set of data used to evaluate the final performance of the model after training and hyperparameter selection. This set is not used at all during the training or validation processes, allowing for an unbiased evaluation of the model.",[293,732,733],{},[11,734,735],{},"As a tip, if you use AI agents for software development, a good practice is to use different sessions or agents for each stage of development, one agent for code generation, another for review, and another for testing. In this case, it helps ensure that the AI is not self-referential and can detect errors that a single agent might miss.",[11,737,738],{},"For model training, an appropriate machine learning algorithm is selected for the type of problem being addressed (classification, regression, clustering, etc.). Some common examples include:",[34,740,741,747,753,759,765,771],{},[37,742,743,746],{},[40,744,745],{},"Linear Regression",": A simple model for linear relationships, fast and interpretable but limited to linear relationships.",[37,748,749,752],{},[40,750,751],{},"Decision Trees",": Models based on rules, easy to interpret but prone to overfitting.",[37,754,755,758],{},[40,756,757],{},"Random Forest",": A collection of decision trees that reduces overfitting but is less interpretable.",[37,760,761,764],{},[40,762,763],{},"Gradient Boosting (XGBoost, LightGBM)",": Potente para datos tabulares, pero puede ser lento y propenso a sobreajuste si no se ajusta correctamente.",[37,766,767,770],{},[40,768,769],{},"Redes neuronales",": Modelos inspirados en el cerebro, capaces de capturar relaciones complejas, pero requieren grandes cantidades de datos y son menos interpretables.",[37,772,773,776],{},[40,774,775],{},"Support Vector Machines (SVM)",": Efectivo para problemas de clasificación, pero puede ser lento con grandes conjuntos de datos.",[91,778,780],{"id":779},"_7-model-evaluation","7. Model Evaluation",[11,782,783],{},"Once the model has been trained, it is crucial to evaluate its performance using the validation and test sets. Model evaluation involves measuring its ability to make accurate predictions and generalize to unseen data.\nEvaluation metrics vary depending on the type of problem being addressed. For classification problems, some common metrics include:",[34,785,786,792,798,804,810,816,822],{},[37,787,788,791],{},[40,789,790],{},"Precision",": The proportion of correct predictions over the total number of predictions made.",[37,793,794,797],{},[40,795,796],{},"Recall (Sensitivity)",": The proportion of true positives over the total number of actual positives.",[37,799,800,803],{},[40,801,802],{},"F1-score",": The harmonic mean of precision and recall, useful when there is an imbalance between classes.",[37,805,806,809],{},[40,807,808],{},"AUC-ROC",": Area under the ROC curve, which measures the model's ability to distinguish between classes.\nFor regression problems, some common metrics include:",[37,811,812,815],{},[40,813,814],{},"Mean Squared Error (MSE)",": The average of the squares of the errors between predictions and actual values.",[37,817,818,821],{},[40,819,820],{},"Mean Absolute Error (MAE)",": The average of the absolute values of the errors between predictions and actual values.",[37,823,824,827],{},[40,825,826],{},"R² (Coeficiente de determinación)",": The proportion of the variance in the dependent variable that is predictable from the independent variables.",[299,829,831],{"id":830},"confusion-matrix","Confusion Matrix",[11,833,834],{},"A useful tool for evaluating classification models is the confusion matrix, which shows the number of true positives, false positives, true negatives, and false negatives. This allows for a better understanding of the model's performance and the areas where it may be making errors.",[836,837,838,853],"table",{},[839,840,841],"thead",{},[842,843,844,847,850],"tr",{},[845,846],"th",{},[845,848,849],{},"Predicted Positive",[845,851,852],{},"Predicted Negative",[854,855,856,870],"tbody",{},[842,857,858,864,867],{},[859,860,861],"td",{},[40,862,863],{},"Actual Positive",[859,865,866],{},"True Positives (TP)",[859,868,869],{},"False Negatives (FN)",[842,871,872,877,880],{},[859,873,874],{},[40,875,876],{},"Actual Negative",[859,878,879],{},"False Positives (FP)",[859,881,882],{},"True Negatives (TN)",[299,884,886],{"id":885},"roc-curve","ROC Curve",[11,888,889],{},"The ROC curve (Receiver Operating Characteristic) is a graphical tool that shows the relationship between the true positive rate (TPR) and the false positive rate (FPR) as the classification threshold is varied. The area under the ROC curve (AUC-ROC) is a metric that measures the model's ability to distinguish between classes, with a value of 1 indicating a perfect model and a value of 0.5 indicating a model with no discrimination capability.",[299,891,893],{"id":892},"precision-recall-curve","Precision-Recall Curve",[11,895,896],{},"The precision-recall curve is another graphical tool that shows the relationship between precision and recall as the classification threshold is varied. This curve is especially useful when there is an imbalance between classes, as it focuses on the model's ability to correctly identify the minority class.",[91,898,900],{"id":899},"_8-implementation-and-deployment","8. Implementation and Deployment",[11,902,903],{},"Once the model has been trained and evaluated, the next step is to implement it in a production environment so that it can be used by end users or integrated into existing systems. The implementation and deployment of machine learning models can be challenging due to the need to ensure scalability, security, and maintainability of the model in a production environment. Some key considerations for implementing and deploying machine learning models include:",[34,905,906,912,918,924,930],{},[37,907,908,911],{},[40,909,910],{},"APIs",": Expose the model through a RESTful API or gRPC so that it can be consumed by other applications or services.",[37,913,914,917],{},[40,915,916],{},"Web Applications",": Integrate the model into a web application so that users can interact with it through a graphical interface.",[37,919,920,923],{},[40,921,922],{},"Integration with Existing Systems",": Integrate the model into existing enterprise systems, such as CRM, ERP, or recommendation systems.",[37,925,926,929],{},[40,927,928],{},"Containers and Orchestration",": Use containers (Docker) and orchestration tools (Kubernetes) to facilitate deployment, scalability, and management of the model in production.",[37,931,932,935],{},[40,933,934],{},"Monitoring and Maintenance",": Implement monitoring systems to track the model's performance in production, detect potential issues, and perform updates or retrainings as needed.",[91,937,939],{"id":938},"_9-monitoring-and-maintenance","9. Monitoring and Maintenance",[11,941,942],{},"Once the model is in production, it is crucial to monitor its performance continuously to ensure it remains effective and relevant. Model monitoring involves tracking key metrics, detecting potential issues, and performing adjustments or retrainings as needed. Some issues that may arise during this stage include:",[34,944,945,951,957],{},[37,946,947,950],{},[40,948,949],{},"Data Drift",": Occurs when the distribution of input data changes over time, which can negatively impact the model's performance. It is important to monitor the data distribution and perform retrainings if a significant drift is detected.",[37,952,953,956],{},[40,954,955],{},"Concept Drift",": Occurs when the relationship between features and the target variable changes over time, making the model less effective. It is important to monitor the model's performance and perform adjustments or retrainings if concept drift is detected.",[37,958,959,962],{},[40,960,961],{},"Training-Serving Skew",": Occurs when there are differences between the data used to train the model and the data found in production, which can negatively impact the model's performance. It is important to ensure that training data is representative of production data and perform adjustments if a significant skew is detected.",[11,964,965],{},"To achieve effective monitoring, some best practices can be implemented, such as:",[34,967,968,974,980,986,992,998],{},[37,969,970,973],{},[40,971,972],{},"Defining clear KPIs",": Establish key performance metrics (KPIs) to monitor the model, such as accuracy, recall, F1-score, AUC-ROC, etc.",[37,975,976,979],{},[40,977,978],{},"Implementing alerts",": Configure alerts to notify the team when the model's performance drops below a predefined threshold or when significant drift is detected.",[37,981,982,985],{},[40,983,984],{},"Diversifying metrics",": Monitor multiple metrics to obtain a comprehensive view of the model's performance and detect potential issues from different angles.",[37,987,988,991],{},[40,989,990],{},"Automating retrainings",": Set up automated processes to perform retrainings of the model when significant drift is detected or when the performance falls below a predefined threshold.",[37,993,994,997],{},[40,995,996],{},"Documenting changes",": Maintain a record of the changes made to the model, such as hyperparameter adjustments, changes in training data, etc., to facilitate traceability and understanding of the decisions made.",[37,999,1000,1003],{},[40,1001,1002],{},"Versioning models",": Use versioning tools for models to maintain a history of different versions of the model and facilitate change management and updates.",[11,1005,1006],{},"Typically, the maintenance process follows a procedure like the following:",[1008,1009,1010,1016,1022,1028,1034],"ol",{},[37,1011,1012,1015],{},[40,1013,1014],{},"Continuous monitoring",": Track the model's performance in production using the defined key metrics.",[37,1017,1018,1021],{},[40,1019,1020],{},"Problem detection",": Identify potential problems, such as data drift, concept drift or training-serving skew, through metric and alert monitoring.",[37,1023,1024,1027],{},[40,1025,1026],{},"Root Cause Analysis",": Investigate the underlying causes of the detected problems, such as changes in data distribution, changes in user behavior, etc.",[37,1029,1030,1033],{},[40,1031,1032],{},"Adjustments or Retraining",": Make adjustments to the model or perform retraining using new data to address the detected problems and improve model performance.",[37,1035,1036,1039],{},[40,1037,1038],{},"Validation and Deployment",": Validate the performance of the adjusted or retrained model using the validation set and then deploy the new version of the model to production.",[11,1041,1042],{},"Some popular tools for monitoring and maintaining machine learning models include:",[34,1044,1045,1051,1057,1063],{},[37,1046,1047,1050],{},[40,1048,1049],{},"Prometheus",": An open-source monitoring and alerting system that can be used to track model performance metrics in production.",[37,1052,1053,1056],{},[40,1054,1055],{},"Grafana",": A data visualization platform that can be integrated with Prometheus to create custom dashboards for monitoring model performance.",[37,1058,1059,1062],{},[40,1060,1061],{},"MLflow",": An open-source platform for managing the lifecycle of machine learning models, including features for monitoring and maintaining models in production.",[37,1064,1065,1068],{},[40,1066,1067],{},"Evidently AI",": Evidently AI is an open-source, cloud-based platform for evaluating, testing, and monitoring AI and machine learning systems.",[28,1070],{},[91,1072,1074],{"id":1073},"case-study-churn-prediction-in-a-fintech-company","Case Study: Churn Prediction in a Fintech Company",[11,1076,1077],{},"We will explore a simulated case study of a machine learning project designed to predict churn in a digital subscription fintech company. This case will illustrate our current understanding of the workflow in a machine learning project.",[11,1079,1080],{},[40,1081,1082],{},"Business Context",[11,1084,1085],{},"A digital subscription fintech company has:",[34,1087,1088,1093,1099,1105],{},[37,1089,1090],{},[40,1091,1092],{},"120,000 active users",[37,1094,1095,1096],{},"Average monthly subscription: ",[40,1097,1098],{},"$25",[37,1100,1101,1102],{},"Monthly Recurring Revenue (MRR): ",[40,1103,1104],{},"$3,000,000",[37,1106,1107,1108],{},"Monthly churn rate: ",[40,1109,1110],{},"8%",[11,1112,1113],{},"This means that each month:",[443,1115,1118],{"className":1116,"code":1117,"language":448},[446],"120,000 × 8% = 9,600 users cancel\n",[404,1119,1117],{"__ignoreMap":451},[11,1121,1122],{},"Estimated monthly loss:",[443,1124,1127],{"className":1125,"code":1126,"language":448},[446],"9,600 × $25 = $240,000\n",[404,1128,1126],{"__ignoreMap":451},[11,1130,1131,1132,1135],{},"The company wants to reduce churn to ",[40,1133,1134],{},"6%",", which would mean saving:",[443,1137,1140],{"className":1138,"code":1139,"language":448},[446],"2% × 120,000 × $25 = $60,000 per month\n",[404,1141,1139],{"__ignoreMap":451},[11,1143,1144,1145,1148],{},"The goal of the Machine Learning project is to ",[40,1146,1147],{},"identify users with a high probability of canceling within the next 30 days",", to send them a personalized retention campaign.",[299,1150,1152],{"id":1151},"problem-definition","Problem Definition",[34,1154,1155],{},[37,1156,1157],{},[40,1158,104],{},[11,1160,1161],{},"Reduce the monthly churn rate from 8% to 6%.",[34,1163,1164],{},[37,1165,1166],{},[40,1167,110],{},[11,1169,1170,1173],{},[404,1171,1172],{},"churn_30d",":",[443,1175,1178],{"className":1176,"code":1177,"language":448},[446],"1 - Cancels within the next 30 days\n0 - Does not cancel\n",[404,1179,1177],{"__ignoreMap":451},[34,1181,1182],{},[37,1183,1184],{},[40,1185,1186],{},"Problem Type",[11,1188,1189],{},"Binary classification.",[34,1191,1192],{},[37,1193,1194],{},[40,1195,1196],{},"Key Business Metric",[11,1198,1199],{},"Accuracy (i.e., the overall success rate) is not enough. The important factors are:",[443,1201,1204],{"className":1202,"code":1203,"language":448},[446],"Recall rate of churn users\nROI of the retention campaign\n",[404,1205,1203],{"__ignoreMap":451},[11,1207,1208],{},"Why? Because we want to accurately identify users who will cancel (recall) and ensure that the retention campaign is profitable (ROI).",[299,1210,1212],{"id":1211},"data-collection","Data Collection",[11,1214,1215],{},"Data was collected from:",[34,1217,1218],{},[37,1219,1220],{},[40,1221,1222],{},"Internal Sources",[443,1224,1227],{"className":1225,"code":1226,"language":448},[446],"* Payment history\n* App usage frequency\n* Time since last login\n* Support tickets\n* Plan type\n* Payment method\n* Payment failure history\n",[404,1228,1226],{"__ignoreMap":451},[34,1230,1231],{},[37,1232,1233],{},[40,1234,1235],{},"Data Volume",[443,1237,1240],{"className":1238,"code":1239,"language":448},[446],"* 18 months of historical data\n* 1.5 million monthly sign-ups\n* Final dataset: **95,000 unique users** with complete history\n",[404,1241,1239],{"__ignoreMap":451},[299,1243,1245],{"id":1244},"preprocessing","Preprocessing",[11,1247,1248],{},"Problems Detected:",[443,1250,1253],{"className":1251,"code":1252,"language":448},[446],"* 7% null values ​​in \"last login\"\n* 3% duplicate records\n* Categorical variables with high cardinality (cities)\n",[404,1254,1252],{"__ignoreMap":451},[11,1256,1257],{},"Actions Taken:",[443,1259,1262],{"className":1260,"code":1261,"language":448},[446],"* Imputation with median for numerical variables\n* Removal of duplicates\n* Grouping of infrequent cities as \"Other\"\n",[404,1263,1261],{"__ignoreMap":451},[11,1265,1266,1267],{},"Time spent on this stage: ",[40,1268,1269],{},"72% of the project",[299,1271,1273],{"id":1272},"exploratory-analysis","Exploratory Analysis",[11,1275,1276],{},"Key Findings:",[34,1278,1279],{},[37,1280,1281],{},[40,1282,1283],{},"Insight 1",[11,1285,1286],{},"Users who do not log in for 14 days have:",[443,1288,1291],{"className":1289,"code":1290,"language":448},[446],"* 22% probability of churn\n\nvs.\n\n* 4% for recently active users\n",[404,1292,1290],{"__ignoreMap":451},[34,1294,1295],{},[37,1296,1297],{},[40,1298,1299],{},"Insight 2",[11,1301,1302],{},"Users with more than 2 payment failures in 60 days:",[443,1304,1307],{"className":1305,"code":1306,"language":448},[446],"* 35% probability of Churn\n",[404,1308,1306],{"__ignoreMap":451},[34,1310,1311],{},[37,1312,1313],{},[40,1314,1315],{},"Insight 3",[11,1317,1318],{},"Users who opened more than 3 support tickets:",[443,1320,1323],{"className":1321,"code":1322,"language":448},[446],"* 18% churn\n* Main cause: technical issues\n",[404,1324,1322],{"__ignoreMap":451},[11,1326,1327],{},"This changes our focus: it's not just a retention issue, but also a user experience and technical support issue. This data tells us that users who have technical problems or difficulties using the app are much more likely to cancel, suggesting that an effective retention campaign should also address these issues and improve the user experience.",[299,1329,1331],{"id":1330},"feature-engineering","Feature Engineering",[11,1333,1334],{},"Variables such as the following were created:",[34,1336,1337,1343,1349,1355,1361,1371],{},[37,1338,1339,1342],{},[404,1340,1341],{},"days_since_last_login",": This is the number of days since the user last logged into the application. This variable is important because, as discovered in the exploratory analysis, users who don't log in for an extended period are more likely to cancel their subscription.",[37,1344,1345,1348],{},[404,1346,1347],{},"number_of_payment_failures_60d",": This is the number of payment failures a user has experienced in the last 60 days. As discovered in the EDA, users with more than 2 payment failures in this period have a significantly higher probability of canceling their subscription.",[37,1350,1351,1354],{},[404,1352,1353],{},"average_weekly_usage",": This is the average weekly usage of the application. This variable can help capture the user's level of engagement with the application, which can be an important indicator of their likelihood of canceling.",[37,1356,1357,1360],{},[404,1358,1359],{},"customer_time_in_months",": Users who have been customers for longer periods may have a lower probability of canceling.",[37,1362,1363,1366,1367,1370],{},[404,1364,1365],{},"support_tickets_90d",": This is the number of support tickets a user has opened in the last 90 days. Since it was discovered that users who open more than 3 support tickets have a higher probability of canceling, this variable can be an important indicator of churn risk. * ",[404,1368,1369],{},"payment_failure_ratio = failures \u002F attempts",": This ratio can be a more accurate indicator of churn risk related to payment issues, as it takes into account both the number of failed payments and the total number of payment attempts.",[37,1372,1373,1374,1377],{},"Binary variable: ",[404,1375,1376],{},"is_new_user (\u003C3 months)",": New users may have a different churn risk compared to older users, so this variable can help capture that difference.",[11,1379,1380],{},"Also created:",[443,1382,1385],{"className":1383,"code":1384,"language":448},[446],"inactivity_risk = days_since_last_login × (1 \u002F average_usage)\n",[404,1386,1384],{"__ignoreMap":451},[11,1388,1389,1390,1393],{},"This composite variable can be a powerful indicator of churn risk, as it combines information about user inactivity (days since last login) with their engagement level (average weekly usage). A high ",[404,1391,1392],{},"risk_inactivity"," value would indicate that a user has not logged in for a long time and has a low level of usage, which could be a strong indicator that they are at risk of canceling their subscription.",[299,1395,1397],{"id":1396},"model-training","Model Training",[11,1399,1400],{},"Data was divided as follows:",[34,1402,1403,1406,1409],{},[37,1404,1405],{},"75% training",[37,1407,1408],{},"15% validation",[37,1410,1411],{},"10% testing",[11,1413,1414],{},"The following were tested:",[836,1416,1417,1429],{},[839,1418,1419],{},[842,1420,1421,1424,1426],{},[845,1422,1423],{},"Model",[845,1425,808],{},[845,1427,1428],{},"Recall churn",[854,1430,1431,1442,1452,1463],{},[842,1432,1433,1436,1439],{},[859,1434,1435],{},"Logistic Regression",[859,1437,1438],{},"0.76",[859,1440,1441],{},"0.58",[842,1443,1444,1446,1449],{},[859,1445,757],{},[859,1447,1448],{},"0.84",[859,1450,1451],{},"0.71",[842,1453,1454,1457,1460],{},[859,1455,1456],{},"XGBoost",[859,1458,1459],{},"0.87",[859,1461,1462],{},"0.78",[842,1464,1465,1468,1471],{},[859,1466,1467],{},"Neural Network",[859,1469,1470],{},"0.85",[859,1472,1473],{},"0.73",[11,1475,1476,1477,1479],{},"Although XGBoost had better metrics, ",[40,1478,757],{}," was initially chosen because:",[34,1481,1482,1485,1488],{},[37,1483,1484],{},"It was more interpretable",[37,1486,1487],{},"Lower risk of overfitting",[37,1489,1490],{},"Easier to maintain",[11,1492,1493,1494,1497],{},"This is key: ",[40,1495,1496],{},"the best metric is not always the best business decision",".",[299,1499,1501],{"id":1500},"evaluation","Evaluation",[11,1503,1504],{},"In the test set:",[34,1506,1507,1510,1513],{},[37,1508,1509],{},"9% actual churn",[37,1511,1512],{},"Model detected 76% of churns",[37,1514,1515],{},"False positives: 18%",[11,1517,1518],{},"Simulation:",[11,1520,1521],{},"Intervention is only implemented for users with a probability > 0.65.",[11,1523,1524],{},"Users marked as \"high risk\": 11,000",[11,1526,1527],{},"Of those:",[34,1529,1530,1533],{},[37,1531,1532],{},"6,800 were actually going to cancel",[37,1534,1535],{},"4,200 were false positives",[11,1537,1538],{},"Campaign cost:",[11,1540,1541,1542,1600],{},"11,000 × ",[383,1543,1546,1573],{"className":1544},[1545],"katex",[383,1547,1550],{"className":1548},[1549],"katex-mathml",[1551,1552,1554],"math",{"xmlns":1553},"http:\u002F\u002Fwww.w3.org\u002F1998\u002FMath\u002FMathML",[1555,1556,1557,1568],"semantics",{},[1558,1559,1560,1564],"mrow",{},[1561,1562,1563],"mn",{},"2",[1565,1566,1567],"mo",{},"=",[1569,1570,1572],"annotation",{"encoding":1571},"application\u002Fx-tex","2 = ",[383,1574,1578],{"className":1575,"ariaHidden":1577},[1576],"katex-html","true",[383,1579,1582,1587,1591,1596],{"className":1580},[1581],"base",[383,1583],{"className":1584,"style":1586},[1585],"strut","height:0.6444em;",[383,1588,1563],{"className":1589},[1590],"mord",[383,1592],{"className":1593,"style":1595},[1594],"mspace","margin-right:0.2778em;",[383,1597,1567],{"className":1598},[1599],"mrel","22,000",[11,1602,1603],{},"Customers saved (campaign success rate 40%):",[11,1605,1606],{},"6,800 × 40% = 2,720 retained customers",[11,1608,1609],{},"Monthly revenue recovered:",[11,1611,1612,1613,1651],{},"2,720 × ",[383,1614,1616,1633],{"className":1615},[1545],[383,1617,1619],{"className":1618},[1549],[1551,1620,1621],{"xmlns":1553},[1555,1622,1623,1630],{},[1558,1624,1625,1628],{},[1561,1626,1627],{},"25",[1565,1629,1567],{},[1569,1631,1632],{"encoding":1571},"25 = ",[383,1634,1636],{"className":1635,"ariaHidden":1577},[1576],[383,1637,1639,1642,1645,1648],{"className":1638},[1581],[383,1640],{"className":1641,"style":1586},[1585],[383,1643,1627],{"className":1644},[1590],[383,1646],{"className":1647,"style":1595},[1594],[383,1649,1567],{"className":1650},[1599],"68,000",[11,1653,1654],{},"Monthly ROI:",[11,1656,1657,1711],{},[383,1658,1660,1684],{"className":1659},[1545],[383,1661,1663],{"className":1662},[1549],[1551,1664,1665],{"xmlns":1553},[1555,1666,1667,1681],{},[1558,1668,1669,1672,1675,1678],{},[1561,1670,1671],{},"68",[1565,1673,1674],{"separator":1577},",",[1561,1676,1677],{},"000",[1565,1679,1680],{},"−",[1569,1682,1683],{"encoding":1571},"68,000 - ",[383,1685,1687],{"className":1686,"ariaHidden":1577},[1576],[383,1688,1690,1694,1697,1701,1705,1708],{"className":1689},[1581],[383,1691],{"className":1692,"style":1693},[1585],"height:0.8389em;vertical-align:-0.1944em;",[383,1695,1671],{"className":1696},[1590],[383,1698,1674],{"className":1699},[1700],"mpunct",[383,1702],{"className":1703,"style":1704},[1594],"margin-right:0.1667em;",[383,1706,1677],{"className":1707},[1590],[383,1709,1680],{"className":1710},[1590],"22,000 = $46,000 net profit",[11,1713,1714],{},"Goal achieved.",[299,1716,1718],{"id":1717},"implementation","Implementation",[11,1720,1721],{},"The model was deployed as:",[34,1723,1724,1727,1730,1733],{},[37,1725,1726],{},"REST API on FastAPI",[37,1728,1729],{},"Docker container",[37,1731,1732],{},"Nightly job that recalculates daily risk",[37,1734,1735],{},"CRM integration to trigger automated campaigns",[11,1737,1738],{},"Inference time per user: 12 ms",[299,1740,1742],{"id":1741},"production-monitoring","Production Monitoring",[11,1744,1745],{},"After 4 months:",[11,1747,1748],{},"The churn rate rose again to 7.4%.",[11,1750,1751],{},"The following were detected:",[34,1753,1754,1757],{},[37,1755,1756],{},"New competitor with aggressive discounts",[37,1758,1759],{},"Change in the behavior of younger users",[11,1761,1762,1765],{},[40,1763,1764],{},"Concept drift"," was identified; that is, the model was no longer accurately capturing churn patterns due to changes in the market and user behavior.",[11,1767,1768],{},"Retraining was performed using recent data.",[11,1770,1771],{},"New model:",[34,1773,1774,1777],{},[37,1775,1776],{},"Improved recall to 81%",[37,1778,1779],{},"Reduced churn again to 6.2%",[28,1781],{},[11,1783,1784,1785,1788],{},"What can we learn from this case? First, ",[40,1786,1787],{},"the model wasn't the focus—the process was",". Success didn't come from a sophisticated algorithm, but from a well-executed process that included:",[34,1790,1791,1794,1797],{},[37,1792,1793],{},"Good EDA (Engineering Development Analysis)",[37,1795,1796],{},"Good feature engineering",[37,1798,1799],{},"Correctly defining the business metrics",[11,1801,1802],{},"Second, accuracy wasn't the right metric. At this point, we needed to focus on ROI, because we didn't just want a model that performed well in technical metrics, but one that also generated a positive impact on the business.",[11,1804,1805,1806,1809],{},"As we've already mentioned, ",[40,1807,1808],{},"the model is part of a system"," that includes other components such as marketing, CRM, infrastructure, monitoring, and retraining. The project's success depends on the effective integration of all these components, not just the model itself.",[11,1811,1812,1813,1816],{},"Third, the project never ends; ",[40,1814,1815],{},"it's a continuous cycle",". Monitoring and maintenance are just as important as the initial training because the environment changes, users change, the market changes, and the model must adapt to remain effective.",[28,1818],{},{"title":451,"searchDepth":1820,"depth":1820,"links":1821},3,[1822,1824,1825,1826,1829,1839,1840,1845,1846,1847],{"id":93,"depth":1823,"text":94},2,{"id":156,"depth":1823,"text":157},{"id":192,"depth":1823,"text":193},{"id":202,"depth":1823,"text":203,"children":1827},[1828],{"id":301,"depth":1820,"text":302},{"id":331,"depth":1823,"text":332,"children":1830},[1831,1832,1833,1834,1835,1836,1837,1838],{"id":367,"depth":1820,"text":368},{"id":429,"depth":1820,"text":430},{"id":490,"depth":1820,"text":491},{"id":540,"depth":1820,"text":541},{"id":589,"depth":1820,"text":590},{"id":621,"depth":1820,"text":622},{"id":650,"depth":1820,"text":651},{"id":673,"depth":1820,"text":674},{"id":700,"depth":1823,"text":701},{"id":779,"depth":1823,"text":780,"children":1841},[1842,1843,1844],{"id":830,"depth":1820,"text":831},{"id":885,"depth":1820,"text":886},{"id":892,"depth":1820,"text":893},{"id":899,"depth":1823,"text":900},{"id":938,"depth":1823,"text":939},{"id":1073,"depth":1823,"text":1074,"children":1848},[1849,1850,1851,1852,1853,1854,1855,1856,1857],{"id":1151,"depth":1820,"text":1152},{"id":1211,"depth":1820,"text":1212},{"id":1244,"depth":1820,"text":1245},{"id":1272,"depth":1820,"text":1273},{"id":1330,"depth":1820,"text":1331},{"id":1396,"depth":1820,"text":1397},{"id":1500,"depth":1820,"text":1501},{"id":1717,"depth":1820,"text":1718},{"id":1741,"depth":1820,"text":1742},"2026-04-18","md","\u002Fblog\u002Fworkflow-machine-learning-projects\u002Fshared\u002Fworkflow.webp",{},true,4,"\u002Fblog\u002Fblog\u002Fworkflow-machine-learning-projects",{"title":5,"description":13},{"loc":1867,"priority":1868,"lastmod":1858},"\u002Fblog\u002Fworkflow-machine-learning-projects",0.7,"workflow-machine-learning-projects","blog\u002Fblog\u002Fworkflow-machine-learning-projects","Discover the typical workflow of a machine learning project, from data collection to model implementation, and learn about best practices and common challenges in the field of data science.",[1873,1874,1875,1876],"Machine Learning","Data Science","ML Projects","Workflow","MXgkwZT0KjAXfrhqOqfXLt24tkatVQk20fUyAE_f-Qw",{"prev":1879,"next":19233},{"id":1880,"title":1881,"author":6,"body":1882,"date":19220,"description":1886,"extension":1859,"image":19221,"lastmod":19220,"meta":19222,"navigation":1862,"order":1820,"path":19223,"seo":19224,"sitemap":19225,"slug":19227,"stem":19228,"summary":19229,"tags":19230,"__hash__":19232},"content_en\u002Fblog\u002Fblog\u002Fmachine-learning-paradigms-and-mathematical-foundations.md","Machine learning paradigms and mathematical foundations",{"type":8,"value":1883,"toc":19204},[1884,1887,1894,1896,1898,1902,1905,1909,1912,2491,2578,2581,2595,2597,2601,2810,2824,2826,2830,2833,2859,2862,2864,2868,2878,2881,2884,2887,3368,3371,3993,4055,4166,4265,4274,4277,4348,4388,4654,4657,4995,4998,5433,5435,5714,5717,6017,6020,6396,6438,6443,6621,7209,7450,7452,7762,7765,7803,7810,7995,7997,8236,8378,8953,9190,9192,9500,9503,10109,10467,10656,10781,10883,10886,11042,11049,11451,11453,11672,11677,12266,12271,12514,12933,12938,13237,13273,13284,13286,13289,13292,13295,13315,13320,13323,13445,13570,13577,13586,14036,14045,14239,14244,14870,14872,15413,15416,15421,15424,15613,15615,16170,16223,16226,16369,16376,16520,16821,16834,16837,17157,17160,17788,17790,18067,18070,18081,18084,18092,18095,18100,18375,18380,18675,18678,18682,18685,18691,18710,18714,18738,18743,18747,18754,18757,18864,18866,18984,18987,19086,19089,19098,19112,19115,19142,19146,19149],[11,1885,1886],{},"We continue learning about Machine Learning, this time we will delve into the different paradigms of machine learning and the mathematical foundations that support these models.",[11,1888,16,1889],{},[18,1890,1893],{"href":1891,"rel":1892},"https:\u002F\u002Fderas.dev\u002Fblog\u002Fmachine-learning-fundamentals",[22],"Machine Learning Fundamentals",[25,1895],{},[28,1897],{},[91,1899,1901],{"id":1900},"machine-learning-paradigms","Machine Learning Paradigms",[11,1903,1904],{},"In the previous article, we already mentioned the types of machine learning, in this section we will review them and then move on to the mathematical foundations.",[299,1906,1908],{"id":1907},"supervised-learning","Supervised Learning",[11,1910,1911],{},"Supervised learning requires a dataset where each input example X is associated with a label or output Y. The objective of the model is to learn a function that maps inputs to correct outputs.",[11,1913,1914,1915,2344,2345,2418,2419,2490],{},"Based on this, the training dataset is represented as a set of pairs ",[383,1916,1918,2012],{"className":1917},[1545],[383,1919,1921],{"className":1920},[1549],[1551,1922,1923],{"xmlns":1553},[1555,1924,1925,2009],{},[1558,1926,1927,1931,1934,1944,1946,1953,1956,1958,1960,1966,1968,1974,1976,1978,1981,1983,1985,1987,1989,1996,1998,2004,2006],{},[1565,1928,1930],{"stretchy":1929},"false","{",[1565,1932,1933],{"stretchy":1929},"(",[1935,1936,1937,1941],"msub",{},[1938,1939,1940],"mi",{},"x",[1561,1942,1943],{},"1",[1565,1945,1674],{"separator":1577},[1935,1947,1948,1951],{},[1938,1949,1950],{},"y",[1561,1952,1943],{},[1565,1954,1955],{"stretchy":1929},")",[1565,1957,1674],{"separator":1577},[1565,1959,1933],{"stretchy":1929},[1935,1961,1962,1964],{},[1938,1963,1940],{},[1561,1965,1563],{},[1565,1967,1674],{"separator":1577},[1935,1969,1970,1972],{},[1938,1971,1950],{},[1561,1973,1563],{},[1565,1975,1955],{"stretchy":1929},[1565,1977,1674],{"separator":1577},[1938,1979,1497],{"mathvariant":1980},"normal",[1938,1982,1497],{"mathvariant":1980},[1938,1984,1497],{"mathvariant":1980},[1565,1986,1674],{"separator":1577},[1565,1988,1933],{"stretchy":1929},[1935,1990,1991,1993],{},[1938,1992,1940],{},[1938,1994,1995],{},"n",[1565,1997,1674],{"separator":1577},[1935,1999,2000,2002],{},[1938,2001,1950],{},[1938,2003,1995],{},[1565,2005,1955],{"stretchy":1929},[1565,2007,2008],{"stretchy":1929},"}",[1569,2010,2011],{"encoding":1571},"\\{(x_1, y_1), (x_2, y_2), ..., (x_n, y_n)\\}",[383,2013,2015],{"className":2014,"ariaHidden":1577},[1576],[383,2016,2018,2022,2027,2084,2087,2090,2132,2136,2139,2142,2145,2185,2188,2191,2231,2234,2237,2240,2244,2247,2250,2253,2294,2297,2300,2340],{"className":2017},[1581],[383,2019],{"className":2020,"style":2021},[1585],"height:1em;vertical-align:-0.25em;",[383,2023,2026],{"className":2024},[2025],"mopen","{(",[383,2028,2030,2034],{"className":2029},[1590],[383,2031,1940],{"className":2032},[1590,2033],"mathnormal",[383,2035,2038],{"className":2036},[2037],"msupsub",[383,2039,2043,2075],{"className":2040},[2041,2042],"vlist-t","vlist-t2",[383,2044,2047,2070],{"className":2045},[2046],"vlist-r",[383,2048,2052],{"className":2049,"style":2051},[2050],"vlist","height:0.3011em;",[383,2053,2055,2060],{"style":2054},"top:-2.55em;margin-left:0em;margin-right:0.05em;",[383,2056],{"className":2057,"style":2059},[2058],"pstrut","height:2.7em;",[383,2061,2067],{"className":2062},[2063,2064,2065,2066],"sizing","reset-size6","size3","mtight",[383,2068,1943],{"className":2069},[1590,2066],[383,2071,2074],{"className":2072},[2073],"vlist-s","​",[383,2076,2078],{"className":2077},[2046],[383,2079,2082],{"className":2080,"style":2081},[2050],"height:0.15em;",[383,2083],{},[383,2085,1674],{"className":2086},[1700],[383,2088],{"className":2089,"style":1704},[1594],[383,2091,2093,2097],{"className":2092},[1590],[383,2094,1950],{"className":2095,"style":2096},[1590,2033],"margin-right:0.0359em;",[383,2098,2100],{"className":2099},[2037],[383,2101,2103,2124],{"className":2102},[2041,2042],[383,2104,2106,2121],{"className":2105},[2046],[383,2107,2109],{"className":2108,"style":2051},[2050],[383,2110,2112,2115],{"style":2111},"top:-2.55em;margin-left:-0.0359em;margin-right:0.05em;",[383,2113],{"className":2114,"style":2059},[2058],[383,2116,2118],{"className":2117},[2063,2064,2065,2066],[383,2119,1943],{"className":2120},[1590,2066],[383,2122,2074],{"className":2123},[2073],[383,2125,2127],{"className":2126},[2046],[383,2128,2130],{"className":2129,"style":2081},[2050],[383,2131],{},[383,2133,1955],{"className":2134},[2135],"mclose",[383,2137,1674],{"className":2138},[1700],[383,2140],{"className":2141,"style":1704},[1594],[383,2143,1933],{"className":2144},[2025],[383,2146,2148,2151],{"className":2147},[1590],[383,2149,1940],{"className":2150},[1590,2033],[383,2152,2154],{"className":2153},[2037],[383,2155,2157,2177],{"className":2156},[2041,2042],[383,2158,2160,2174],{"className":2159},[2046],[383,2161,2163],{"className":2162,"style":2051},[2050],[383,2164,2165,2168],{"style":2054},[383,2166],{"className":2167,"style":2059},[2058],[383,2169,2171],{"className":2170},[2063,2064,2065,2066],[383,2172,1563],{"className":2173},[1590,2066],[383,2175,2074],{"className":2176},[2073],[383,2178,2180],{"className":2179},[2046],[383,2181,2183],{"className":2182,"style":2081},[2050],[383,2184],{},[383,2186,1674],{"className":2187},[1700],[383,2189],{"className":2190,"style":1704},[1594],[383,2192,2194,2197],{"className":2193},[1590],[383,2195,1950],{"className":2196,"style":2096},[1590,2033],[383,2198,2200],{"className":2199},[2037],[383,2201,2203,2223],{"className":2202},[2041,2042],[383,2204,2206,2220],{"className":2205},[2046],[383,2207,2209],{"className":2208,"style":2051},[2050],[383,2210,2211,2214],{"style":2111},[383,2212],{"className":2213,"style":2059},[2058],[383,2215,2217],{"className":2216},[2063,2064,2065,2066],[383,2218,1563],{"className":2219},[1590,2066],[383,2221,2074],{"className":2222},[2073],[383,2224,2226],{"className":2225},[2046],[383,2227,2229],{"className":2228,"style":2081},[2050],[383,2230],{},[383,2232,1955],{"className":2233},[2135],[383,2235,1674],{"className":2236},[1700],[383,2238],{"className":2239,"style":1704},[1594],[383,2241,2243],{"className":2242},[1590],"...",[383,2245,1674],{"className":2246},[1700],[383,2248],{"className":2249,"style":1704},[1594],[383,2251,1933],{"className":2252},[2025],[383,2254,2256,2259],{"className":2255},[1590],[383,2257,1940],{"className":2258},[1590,2033],[383,2260,2262],{"className":2261},[2037],[383,2263,2265,2286],{"className":2264},[2041,2042],[383,2266,2268,2283],{"className":2267},[2046],[383,2269,2272],{"className":2270,"style":2271},[2050],"height:0.1514em;",[383,2273,2274,2277],{"style":2054},[383,2275],{"className":2276,"style":2059},[2058],[383,2278,2280],{"className":2279},[2063,2064,2065,2066],[383,2281,1995],{"className":2282},[1590,2033,2066],[383,2284,2074],{"className":2285},[2073],[383,2287,2289],{"className":2288},[2046],[383,2290,2292],{"className":2291,"style":2081},[2050],[383,2293],{},[383,2295,1674],{"className":2296},[1700],[383,2298],{"className":2299,"style":1704},[1594],[383,2301,2303,2306],{"className":2302},[1590],[383,2304,1950],{"className":2305,"style":2096},[1590,2033],[383,2307,2309],{"className":2308},[2037],[383,2310,2312,2332],{"className":2311},[2041,2042],[383,2313,2315,2329],{"className":2314},[2046],[383,2316,2318],{"className":2317,"style":2271},[2050],[383,2319,2320,2323],{"style":2111},[383,2321],{"className":2322,"style":2059},[2058],[383,2324,2326],{"className":2325},[2063,2064,2065,2066],[383,2327,1995],{"className":2328},[1590,2033,2066],[383,2330,2074],{"className":2331},[2073],[383,2333,2335],{"className":2334},[2046],[383,2336,2338],{"className":2337,"style":2081},[2050],[383,2339],{},[383,2341,2343],{"className":2342},[2135],")}",", where ",[383,2346,2348,2367],{"className":2347},[1545],[383,2349,2351],{"className":2350},[1549],[1551,2352,2353],{"xmlns":1553},[1555,2354,2355,2364],{},[1558,2356,2357],{},[1935,2358,2359,2361],{},[1938,2360,1940],{},[1938,2362,2363],{},"i",[1569,2365,2366],{"encoding":1571},"x_i",[383,2368,2370],{"className":2369,"ariaHidden":1577},[1576],[383,2371,2373,2377],{"className":2372},[1581],[383,2374],{"className":2375,"style":2376},[1585],"height:0.5806em;vertical-align:-0.15em;",[383,2378,2380,2383],{"className":2379},[1590],[383,2381,1940],{"className":2382},[1590,2033],[383,2384,2386],{"className":2385},[2037],[383,2387,2389,2410],{"className":2388},[2041,2042],[383,2390,2392,2407],{"className":2391},[2046],[383,2393,2396],{"className":2394,"style":2395},[2050],"height:0.3117em;",[383,2397,2398,2401],{"style":2054},[383,2399],{"className":2400,"style":2059},[2058],[383,2402,2404],{"className":2403},[2063,2064,2065,2066],[383,2405,2363],{"className":2406},[1590,2033,2066],[383,2408,2074],{"className":2409},[2073],[383,2411,2413],{"className":2412},[2046],[383,2414,2416],{"className":2415,"style":2081},[2050],[383,2417],{}," is the input and ",[383,2420,2422,2440],{"className":2421},[1545],[383,2423,2425],{"className":2424},[1549],[1551,2426,2427],{"xmlns":1553},[1555,2428,2429,2437],{},[1558,2430,2431],{},[1935,2432,2433,2435],{},[1938,2434,1950],{},[1938,2436,2363],{},[1569,2438,2439],{"encoding":1571},"y_i",[383,2441,2443],{"className":2442,"ariaHidden":1577},[1576],[383,2444,2446,2450],{"className":2445},[1581],[383,2447],{"className":2448,"style":2449},[1585],"height:0.625em;vertical-align:-0.1944em;",[383,2451,2453,2456],{"className":2452},[1590],[383,2454,1950],{"className":2455,"style":2096},[1590,2033],[383,2457,2459],{"className":2458},[2037],[383,2460,2462,2482],{"className":2461},[2041,2042],[383,2463,2465,2479],{"className":2464},[2046],[383,2466,2468],{"className":2467,"style":2395},[2050],[383,2469,2470,2473],{"style":2111},[383,2471],{"className":2472,"style":2059},[2058],[383,2474,2476],{"className":2475},[2063,2064,2065,2066],[383,2477,2363],{"className":2478},[1590,2033,2066],[383,2480,2074],{"className":2481},[2073],[383,2483,2485],{"className":2484},[2046],[383,2486,2488],{"className":2487,"style":2081},[2050],[383,2489],{}," is the corresponding label. The supervised learning model attempts to find a function f that can predict the output Y from the input X:",[383,2492,2495],{"className":2493},[2494],"katex-display",[383,2496,2498,2525],{"className":2497},[1545],[383,2499,2501],{"className":2500},[1549],[1551,2502,2504],{"xmlns":1553,"display":2503},"block",[1555,2505,2506,2522],{},[1558,2507,2508,2511,2513,2516,2519],{},[1938,2509,2510],{},"f",[1565,2512,1173],{},[1938,2514,2515],{},"X",[1565,2517,2518],{},"→",[1938,2520,2521],{},"Y",[1569,2523,2524],{"encoding":1571},"f: X \\rightarrow Y",[383,2526,2528,2548,2568],{"className":2527,"ariaHidden":1577},[1576],[383,2529,2531,2535,2539,2542,2545],{"className":2530},[1581],[383,2532],{"className":2533,"style":2534},[1585],"height:0.8889em;vertical-align:-0.1944em;",[383,2536,2510],{"className":2537,"style":2538},[1590,2033],"margin-right:0.1076em;",[383,2540],{"className":2541,"style":1595},[1594],[383,2543,1173],{"className":2544},[1599],[383,2546],{"className":2547,"style":1595},[1594],[383,2549,2551,2555,2559,2562,2565],{"className":2550},[1581],[383,2552],{"className":2553,"style":2554},[1585],"height:0.6833em;",[383,2556,2515],{"className":2557,"style":2558},[1590,2033],"margin-right:0.0785em;",[383,2560],{"className":2561,"style":1595},[1594],[383,2563,2518],{"className":2564},[1599],[383,2566],{"className":2567,"style":1595},[1594],[383,2569,2571,2574],{"className":2570},[1581],[383,2572],{"className":2573,"style":2554},[1585],[383,2575,2521],{"className":2576,"style":2577},[1590,2033],"margin-right:0.2222em;",[11,2579,2580],{},"Depending on the type of output, supervised learning can be divided into:",[34,2582,2583,2589],{},[37,2584,2585,2588],{},[40,2586,2587],{},"Classification",": When the output Y is a discrete category (that is, a categorical value). For example, classifying whether an image contains a cat or a dog, whether a number is even or odd, or whether an email is spam or not spam.",[37,2590,2591,2594],{},[40,2592,2593],{},"Regression",": When the output Y is a continuous value (that is, a real number). For example, making predictions about future sales based on historical data, predicting the price of a house based on its features, or estimating the temperature of a city based on climatic factors.",[28,2596],{},[299,2598,2600],{"id":2599},"unsupervised-learning","Unsupervised Learning",[11,2602,2603,2604,2809],{},"In unsupervised learning, the model receives only the inputs X without associated labels: ",[383,2605,2607,2653],{"className":2606},[1545],[383,2608,2610],{"className":2609},[1549],[1551,2611,2612],{"xmlns":1553},[1555,2613,2614,2650],{},[1558,2615,2616,2618,2624,2626,2632,2634,2636,2638,2640,2642,2648],{},[1565,2617,1930],{"stretchy":1929},[1935,2619,2620,2622],{},[1938,2621,1940],{},[1561,2623,1943],{},[1565,2625,1674],{"separator":1577},[1935,2627,2628,2630],{},[1938,2629,1940],{},[1561,2631,1563],{},[1565,2633,1674],{"separator":1577},[1938,2635,1497],{"mathvariant":1980},[1938,2637,1497],{"mathvariant":1980},[1938,2639,1497],{"mathvariant":1980},[1565,2641,1674],{"separator":1577},[1935,2643,2644,2646],{},[1938,2645,1940],{},[1938,2647,1995],{},[1565,2649,2008],{"stretchy":1929},[1569,2651,2652],{"encoding":1571},"\\{x_1, x_2, ..., x_n\\}",[383,2654,2656],{"className":2655,"ariaHidden":1577},[1576],[383,2657,2659,2662,2665,2705,2708,2711,2751,2754,2757,2760,2763,2766,2806],{"className":2658},[1581],[383,2660],{"className":2661,"style":2021},[1585],[383,2663,1930],{"className":2664},[2025],[383,2666,2668,2671],{"className":2667},[1590],[383,2669,1940],{"className":2670},[1590,2033],[383,2672,2674],{"className":2673},[2037],[383,2675,2677,2697],{"className":2676},[2041,2042],[383,2678,2680,2694],{"className":2679},[2046],[383,2681,2683],{"className":2682,"style":2051},[2050],[383,2684,2685,2688],{"style":2054},[383,2686],{"className":2687,"style":2059},[2058],[383,2689,2691],{"className":2690},[2063,2064,2065,2066],[383,2692,1943],{"className":2693},[1590,2066],[383,2695,2074],{"className":2696},[2073],[383,2698,2700],{"className":2699},[2046],[383,2701,2703],{"className":2702,"style":2081},[2050],[383,2704],{},[383,2706,1674],{"className":2707},[1700],[383,2709],{"className":2710,"style":1704},[1594],[383,2712,2714,2717],{"className":2713},[1590],[383,2715,1940],{"className":2716},[1590,2033],[383,2718,2720],{"className":2719},[2037],[383,2721,2723,2743],{"className":2722},[2041,2042],[383,2724,2726,2740],{"className":2725},[2046],[383,2727,2729],{"className":2728,"style":2051},[2050],[383,2730,2731,2734],{"style":2054},[383,2732],{"className":2733,"style":2059},[2058],[383,2735,2737],{"className":2736},[2063,2064,2065,2066],[383,2738,1563],{"className":2739},[1590,2066],[383,2741,2074],{"className":2742},[2073],[383,2744,2746],{"className":2745},[2046],[383,2747,2749],{"className":2748,"style":2081},[2050],[383,2750],{},[383,2752,1674],{"className":2753},[1700],[383,2755],{"className":2756,"style":1704},[1594],[383,2758,2243],{"className":2759},[1590],[383,2761,1674],{"className":2762},[1700],[383,2764],{"className":2765,"style":1704},[1594],[383,2767,2769,2772],{"className":2768},[1590],[383,2770,1940],{"className":2771},[1590,2033],[383,2773,2775],{"className":2774},[2037],[383,2776,2778,2798],{"className":2777},[2041,2042],[383,2779,2781,2795],{"className":2780},[2046],[383,2782,2784],{"className":2783,"style":2271},[2050],[383,2785,2786,2789],{"style":2054},[383,2787],{"className":2788,"style":2059},[2058],[383,2790,2792],{"className":2791},[2063,2064,2065,2066],[383,2793,1995],{"className":2794},[1590,2033,2066],[383,2796,2074],{"className":2797},[2073],[383,2799,2801],{"className":2800},[2046],[383,2802,2804],{"className":2803,"style":2081},[2050],[383,2805],{},[383,2807,2008],{"className":2808},[2135],". The objective is to find underlying patterns or structures in the data.\nSome examples of unsupervised learning techniques include:",[34,2811,2812,2818],{},[37,2813,2814,2817],{},[40,2815,2816],{},"Clustering",": Grouping similar data points into clusters. For example, segmenting customers into groups based on their purchasing behaviors.",[37,2819,2820,2823],{},[40,2821,2822],{},"Dimensionality Reduction",": Reducing the number of variables in a dataset while preserving as much information as possible. For example, using PCA (Principal Component Analysis) to visualize data in 2D or 3D.",[28,2825],{},[299,2827,2829],{"id":2828},"reinforcement-learning","Reinforcement Learning",[11,2831,2832],{},"Reinforcement learning is based on the idea that an agent learns to make decisions by interacting with an environment. The agent receives rewards or penalties based on the actions it takes, and its objective is to maximize the accumulated reward over time.\nIn this paradigm, the agent learns an action policy that allows it to make optimal decisions based on the current state of the environment. A classic example of reinforcement learning is the game of chess, where the agent learns to play better as it plays more games and receives feedback about its moves.",[1008,2834,2835,2841,2847,2853],{},[37,2836,2837,2840],{},[40,2838,2839],{},"Agent",": The system that makes decisions.",[37,2842,2843,2846],{},[40,2844,2845],{},"Environment",": The world with which the agent interacts.",[37,2848,2849,2852],{},[40,2850,2851],{},"Reward",": The feedback that the agent receives after taking an action.",[37,2854,2855,2858],{},[40,2856,2857],{},"Policy",": The strategy that the agent follows to make decisions.",[11,2860,2861],{},"Its applications include games, robotics, and recommendation systems.",[28,2863],{},[91,2865,2867],{"id":2866},"mathematical-foundations","Mathematical Foundations",[11,2869,2870,2871,2874,2875,1497],{},"It is important to understand that machine learning is based on concepts from linear algebra, calculus, probability, and statistics. These fundamentals are essential for understanding how ",[40,2872,2873],{},"models work"," and how they are ",[40,2876,2877],{},"optimized",[299,2879,2593],{"id":2880},"regression",[11,2882,2883],{},"What is a regression problem? It is a type of problem where the objective is to predict a continuous value by finding the best line (or plane) that fits the data. We have already discussed application examples such as price calculation, sales forecasting, etc.",[11,2885,2886],{},"The simplest form of regression is linear regression, which can be mathematically expressed as:",[383,2888,2890],{"className":2889},[2494],[383,2891,2893,2973],{"className":2892},[1545],[383,2894,2896],{"className":2895},[1549],[1551,2897,2898],{"xmlns":1553,"display":2503},[1555,2899,2900,2970],{},[1558,2901,2902,2904,2906,2914,2917,2923,2929,2931,2937,2943,2945,2947,2949,2951,2953,2959,2965,2967],{},[1938,2903,1950],{},[1565,2905,1567],{},[1935,2907,2908,2911],{},[1938,2909,2910],{},"β",[1561,2912,2913],{},"0",[1565,2915,2916],{},"+",[1935,2918,2919,2921],{},[1938,2920,2910],{},[1561,2922,1943],{},[1935,2924,2925,2927],{},[1938,2926,1940],{},[1561,2928,1943],{},[1565,2930,2916],{},[1935,2932,2933,2935],{},[1938,2934,2910],{},[1561,2936,1563],{},[1935,2938,2939,2941],{},[1938,2940,1940],{},[1561,2942,1563],{},[1565,2944,2916],{},[1938,2946,1497],{"mathvariant":1980},[1938,2948,1497],{"mathvariant":1980},[1938,2950,1497],{"mathvariant":1980},[1565,2952,2916],{},[1935,2954,2955,2957],{},[1938,2956,2910],{},[1938,2958,11],{},[1935,2960,2961,2963],{},[1938,2962,1940],{},[1938,2964,11],{},[1565,2966,2916],{},[1938,2968,2969],{},"ϵ",[1569,2971,2972],{"encoding":1571},"y = \\beta_0 + \\beta_1 x_1 + \\beta_2 x_2 + ... + \\beta_p x_p + \\epsilon",[383,2974,2976,2994,3052,3147,3242,3261,3358],{"className":2975,"ariaHidden":1577},[1576],[383,2977,2979,2982,2985,2988,2991],{"className":2978},[1581],[383,2980],{"className":2981,"style":2449},[1585],[383,2983,1950],{"className":2984,"style":2096},[1590,2033],[383,2986],{"className":2987,"style":1595},[1594],[383,2989,1567],{"className":2990},[1599],[383,2992],{"className":2993,"style":1595},[1594],[383,2995,2997,3000,3042,3045,3049],{"className":2996},[1581],[383,2998],{"className":2999,"style":2534},[1585],[383,3001,3003,3007],{"className":3002},[1590],[383,3004,2910],{"className":3005,"style":3006},[1590,2033],"margin-right:0.0528em;",[383,3008,3010],{"className":3009},[2037],[383,3011,3013,3034],{"className":3012},[2041,2042],[383,3014,3016,3031],{"className":3015},[2046],[383,3017,3019],{"className":3018,"style":2051},[2050],[383,3020,3022,3025],{"style":3021},"top:-2.55em;margin-left:-0.0528em;margin-right:0.05em;",[383,3023],{"className":3024,"style":2059},[2058],[383,3026,3028],{"className":3027},[2063,2064,2065,2066],[383,3029,2913],{"className":3030},[1590,2066],[383,3032,2074],{"className":3033},[2073],[383,3035,3037],{"className":3036},[2046],[383,3038,3040],{"className":3039,"style":2081},[2050],[383,3041],{},[383,3043],{"className":3044,"style":2577},[1594],[383,3046,2916],{"className":3047},[3048],"mbin",[383,3050],{"className":3051,"style":2577},[1594],[383,3053,3055,3058,3098,3138,3141,3144],{"className":3054},[1581],[383,3056],{"className":3057,"style":2534},[1585],[383,3059,3061,3064],{"className":3060},[1590],[383,3062,2910],{"className":3063,"style":3006},[1590,2033],[383,3065,3067],{"className":3066},[2037],[383,3068,3070,3090],{"className":3069},[2041,2042],[383,3071,3073,3087],{"className":3072},[2046],[383,3074,3076],{"className":3075,"style":2051},[2050],[383,3077,3078,3081],{"style":3021},[383,3079],{"className":3080,"style":2059},[2058],[383,3082,3084],{"className":3083},[2063,2064,2065,2066],[383,3085,1943],{"className":3086},[1590,2066],[383,3088,2074],{"className":3089},[2073],[383,3091,3093],{"className":3092},[2046],[383,3094,3096],{"className":3095,"style":2081},[2050],[383,3097],{},[383,3099,3101,3104],{"className":3100},[1590],[383,3102,1940],{"className":3103},[1590,2033],[383,3105,3107],{"className":3106},[2037],[383,3108,3110,3130],{"className":3109},[2041,2042],[383,3111,3113,3127],{"className":3112},[2046],[383,3114,3116],{"className":3115,"style":2051},[2050],[383,3117,3118,3121],{"style":2054},[383,3119],{"className":3120,"style":2059},[2058],[383,3122,3124],{"className":3123},[2063,2064,2065,2066],[383,3125,1943],{"className":3126},[1590,2066],[383,3128,2074],{"className":3129},[2073],[383,3131,3133],{"className":3132},[2046],[383,3134,3136],{"className":3135,"style":2081},[2050],[383,3137],{},[383,3139],{"className":3140,"style":2577},[1594],[383,3142,2916],{"className":3143},[3048],[383,3145],{"className":3146,"style":2577},[1594],[383,3148,3150,3153,3193,3233,3236,3239],{"className":3149},[1581],[383,3151],{"className":3152,"style":2534},[1585],[383,3154,3156,3159],{"className":3155},[1590],[383,3157,2910],{"className":3158,"style":3006},[1590,2033],[383,3160,3162],{"className":3161},[2037],[383,3163,3165,3185],{"className":3164},[2041,2042],[383,3166,3168,3182],{"className":3167},[2046],[383,3169,3171],{"className":3170,"style":2051},[2050],[383,3172,3173,3176],{"style":3021},[383,3174],{"className":3175,"style":2059},[2058],[383,3177,3179],{"className":3178},[2063,2064,2065,2066],[383,3180,1563],{"className":3181},[1590,2066],[383,3183,2074],{"className":3184},[2073],[383,3186,3188],{"className":3187},[2046],[383,3189,3191],{"className":3190,"style":2081},[2050],[383,3192],{},[383,3194,3196,3199],{"className":3195},[1590],[383,3197,1940],{"className":3198},[1590,2033],[383,3200,3202],{"className":3201},[2037],[383,3203,3205,3225],{"className":3204},[2041,2042],[383,3206,3208,3222],{"className":3207},[2046],[383,3209,3211],{"className":3210,"style":2051},[2050],[383,3212,3213,3216],{"style":2054},[383,3214],{"className":3215,"style":2059},[2058],[383,3217,3219],{"className":3218},[2063,2064,2065,2066],[383,3220,1563],{"className":3221},[1590,2066],[383,3223,2074],{"className":3224},[2073],[383,3226,3228],{"className":3227},[2046],[383,3229,3231],{"className":3230,"style":2081},[2050],[383,3232],{},[383,3234],{"className":3235,"style":2577},[1594],[383,3237,2916],{"className":3238},[3048],[383,3240],{"className":3241,"style":2577},[1594],[383,3243,3245,3249,3252,3255,3258],{"className":3244},[1581],[383,3246],{"className":3247,"style":3248},[1585],"height:0.6667em;vertical-align:-0.0833em;",[383,3250,2243],{"className":3251},[1590],[383,3253],{"className":3254,"style":2577},[1594],[383,3256,2916],{"className":3257},[3048],[383,3259],{"className":3260,"style":2577},[1594],[383,3262,3264,3268,3309,3349,3352,3355],{"className":3263},[1581],[383,3265],{"className":3266,"style":3267},[1585],"height:0.9805em;vertical-align:-0.2861em;",[383,3269,3271,3274],{"className":3270},[1590],[383,3272,2910],{"className":3273,"style":3006},[1590,2033],[383,3275,3277],{"className":3276},[2037],[383,3278,3280,3300],{"className":3279},[2041,2042],[383,3281,3283,3297],{"className":3282},[2046],[383,3284,3286],{"className":3285,"style":2271},[2050],[383,3287,3288,3291],{"style":3021},[383,3289],{"className":3290,"style":2059},[2058],[383,3292,3294],{"className":3293},[2063,2064,2065,2066],[383,3295,11],{"className":3296},[1590,2033,2066],[383,3298,2074],{"className":3299},[2073],[383,3301,3303],{"className":3302},[2046],[383,3304,3307],{"className":3305,"style":3306},[2050],"height:0.2861em;",[383,3308],{},[383,3310,3312,3315],{"className":3311},[1590],[383,3313,1940],{"className":3314},[1590,2033],[383,3316,3318],{"className":3317},[2037],[383,3319,3321,3341],{"className":3320},[2041,2042],[383,3322,3324,3338],{"className":3323},[2046],[383,3325,3327],{"className":3326,"style":2271},[2050],[383,3328,3329,3332],{"style":2054},[383,3330],{"className":3331,"style":2059},[2058],[383,3333,3335],{"className":3334},[2063,2064,2065,2066],[383,3336,11],{"className":3337},[1590,2033,2066],[383,3339,2074],{"className":3340},[2073],[383,3342,3344],{"className":3343},[2046],[383,3345,3347],{"className":3346,"style":3306},[2050],[383,3348],{},[383,3350],{"className":3351,"style":2577},[1594],[383,3353,2916],{"className":3354},[3048],[383,3356],{"className":3357,"style":2577},[1594],[383,3359,3361,3365],{"className":3360},[1581],[383,3362],{"className":3363,"style":3364},[1585],"height:0.4306em;",[383,3366,2969],{"className":3367},[1590,2033],[11,3369,3370],{},"Where:",[34,3372,3373,3404,3603,3734,3932],{},[37,3374,3375,3403],{},[383,3376,3378,3391],{"className":3377},[1545],[383,3379,3381],{"className":3380},[1549],[1551,3382,3383],{"xmlns":1553},[1555,3384,3385,3389],{},[1558,3386,3387],{},[1938,3388,1950],{},[1569,3390,1950],{"encoding":1571},[383,3392,3394],{"className":3393,"ariaHidden":1577},[1576],[383,3395,3397,3400],{"className":3396},[1581],[383,3398],{"className":3399,"style":2449},[1585],[383,3401,1950],{"className":3402,"style":2096},[1590,2033]," is the dependent variable (what we want to predict).",[37,3405,3406,3602],{},[383,3407,3409,3451],{"className":3408},[1545],[383,3410,3412],{"className":3411},[1549],[1551,3413,3414],{"xmlns":1553},[1555,3415,3416,3448],{},[1558,3417,3418,3424,3426,3432,3434,3436,3438,3440,3442],{},[1935,3419,3420,3422],{},[1938,3421,1940],{},[1561,3423,1943],{},[1565,3425,1674],{"separator":1577},[1935,3427,3428,3430],{},[1938,3429,1940],{},[1561,3431,1563],{},[1565,3433,1674],{"separator":1577},[1938,3435,1497],{"mathvariant":1980},[1938,3437,1497],{"mathvariant":1980},[1938,3439,1497],{"mathvariant":1980},[1565,3441,1674],{"separator":1577},[1935,3443,3444,3446],{},[1938,3445,1940],{},[1938,3447,11],{},[1569,3449,3450],{"encoding":1571},"x_1, x_2, ..., x_p",[383,3452,3454],{"className":3453,"ariaHidden":1577},[1576],[383,3455,3457,3461,3501,3504,3507,3547,3550,3553,3556,3559,3562],{"className":3456},[1581],[383,3458],{"className":3459,"style":3460},[1585],"height:0.7167em;vertical-align:-0.2861em;",[383,3462,3464,3467],{"className":3463},[1590],[383,3465,1940],{"className":3466},[1590,2033],[383,3468,3470],{"className":3469},[2037],[383,3471,3473,3493],{"className":3472},[2041,2042],[383,3474,3476,3490],{"className":3475},[2046],[383,3477,3479],{"className":3478,"style":2051},[2050],[383,3480,3481,3484],{"style":2054},[383,3482],{"className":3483,"style":2059},[2058],[383,3485,3487],{"className":3486},[2063,2064,2065,2066],[383,3488,1943],{"className":3489},[1590,2066],[383,3491,2074],{"className":3492},[2073],[383,3494,3496],{"className":3495},[2046],[383,3497,3499],{"className":3498,"style":2081},[2050],[383,3500],{},[383,3502,1674],{"className":3503},[1700],[383,3505],{"className":3506,"style":1704},[1594],[383,3508,3510,3513],{"className":3509},[1590],[383,3511,1940],{"className":3512},[1590,2033],[383,3514,3516],{"className":3515},[2037],[383,3517,3519,3539],{"className":3518},[2041,2042],[383,3520,3522,3536],{"className":3521},[2046],[383,3523,3525],{"className":3524,"style":2051},[2050],[383,3526,3527,3530],{"style":2054},[383,3528],{"className":3529,"style":2059},[2058],[383,3531,3533],{"className":3532},[2063,2064,2065,2066],[383,3534,1563],{"className":3535},[1590,2066],[383,3537,2074],{"className":3538},[2073],[383,3540,3542],{"className":3541},[2046],[383,3543,3545],{"className":3544,"style":2081},[2050],[383,3546],{},[383,3548,1674],{"className":3549},[1700],[383,3551],{"className":3552,"style":1704},[1594],[383,3554,2243],{"className":3555},[1590],[383,3557,1674],{"className":3558},[1700],[383,3560],{"className":3561,"style":1704},[1594],[383,3563,3565,3568],{"className":3564},[1590],[383,3566,1940],{"className":3567},[1590,2033],[383,3569,3571],{"className":3570},[2037],[383,3572,3574,3594],{"className":3573},[2041,2042],[383,3575,3577,3591],{"className":3576},[2046],[383,3578,3580],{"className":3579,"style":2271},[2050],[383,3581,3582,3585],{"style":2054},[383,3583],{"className":3584,"style":2059},[2058],[383,3586,3588],{"className":3587},[2063,2064,2065,2066],[383,3589,11],{"className":3590},[1590,2033,2066],[383,3592,2074],{"className":3593},[2073],[383,3595,3597],{"className":3596},[2046],[383,3598,3600],{"className":3599,"style":3306},[2050],[383,3601],{}," are the independent variables (the features).",[37,3604,3605,3675,3676,3704,3705,3733],{},[383,3606,3608,3626],{"className":3607},[1545],[383,3609,3611],{"className":3610},[1549],[1551,3612,3613],{"xmlns":1553},[1555,3614,3615,3623],{},[1558,3616,3617],{},[1935,3618,3619,3621],{},[1938,3620,2910],{},[1561,3622,2913],{},[1569,3624,3625],{"encoding":1571},"\\beta_0",[383,3627,3629],{"className":3628,"ariaHidden":1577},[1576],[383,3630,3632,3635],{"className":3631},[1581],[383,3633],{"className":3634,"style":2534},[1585],[383,3636,3638,3641],{"className":3637},[1590],[383,3639,2910],{"className":3640,"style":3006},[1590,2033],[383,3642,3644],{"className":3643},[2037],[383,3645,3647,3667],{"className":3646},[2041,2042],[383,3648,3650,3664],{"className":3649},[2046],[383,3651,3653],{"className":3652,"style":2051},[2050],[383,3654,3655,3658],{"style":3021},[383,3656],{"className":3657,"style":2059},[2058],[383,3659,3661],{"className":3660},[2063,2064,2065,2066],[383,3662,2913],{"className":3663},[1590,2066],[383,3665,2074],{"className":3666},[2073],[383,3668,3670],{"className":3669},[2046],[383,3671,3673],{"className":3672,"style":2081},[2050],[383,3674],{}," is the intercept (the value of ",[383,3677,3679,3692],{"className":3678},[1545],[383,3680,3682],{"className":3681},[1549],[1551,3683,3684],{"xmlns":1553},[1555,3685,3686,3690],{},[1558,3687,3688],{},[1938,3689,1950],{},[1569,3691,1950],{"encoding":1571},[383,3693,3695],{"className":3694,"ariaHidden":1577},[1576],[383,3696,3698,3701],{"className":3697},[1581],[383,3699],{"className":3700,"style":2449},[1585],[383,3702,1950],{"className":3703,"style":2096},[1590,2033]," when all ",[383,3706,3708,3721],{"className":3707},[1545],[383,3709,3711],{"className":3710},[1549],[1551,3712,3713],{"xmlns":1553},[1555,3714,3715,3719],{},[1558,3716,3717],{},[1938,3718,1940],{},[1569,3720,1940],{"encoding":1571},[383,3722,3724],{"className":3723,"ariaHidden":1577},[1576],[383,3725,3727,3730],{"className":3726},[1581],[383,3728],{"className":3729,"style":3364},[1585],[383,3731,1940],{"className":3732},[1590,2033]," are 0).",[37,3735,3736,3931],{},[383,3737,3739,3781],{"className":3738},[1545],[383,3740,3742],{"className":3741},[1549],[1551,3743,3744],{"xmlns":1553},[1555,3745,3746,3778],{},[1558,3747,3748,3754,3756,3762,3764,3766,3768,3770,3772],{},[1935,3749,3750,3752],{},[1938,3751,2910],{},[1561,3753,1943],{},[1565,3755,1674],{"separator":1577},[1935,3757,3758,3760],{},[1938,3759,2910],{},[1561,3761,1563],{},[1565,3763,1674],{"separator":1577},[1938,3765,1497],{"mathvariant":1980},[1938,3767,1497],{"mathvariant":1980},[1938,3769,1497],{"mathvariant":1980},[1565,3771,1674],{"separator":1577},[1935,3773,3774,3776],{},[1938,3775,2910],{},[1938,3777,11],{},[1569,3779,3780],{"encoding":1571},"\\beta_1, \\beta_2, ..., \\beta_p",[383,3782,3784],{"className":3783,"ariaHidden":1577},[1576],[383,3785,3787,3790,3830,3833,3836,3876,3879,3882,3885,3888,3891],{"className":3786},[1581],[383,3788],{"className":3789,"style":3267},[1585],[383,3791,3793,3796],{"className":3792},[1590],[383,3794,2910],{"className":3795,"style":3006},[1590,2033],[383,3797,3799],{"className":3798},[2037],[383,3800,3802,3822],{"className":3801},[2041,2042],[383,3803,3805,3819],{"className":3804},[2046],[383,3806,3808],{"className":3807,"style":2051},[2050],[383,3809,3810,3813],{"style":3021},[383,3811],{"className":3812,"style":2059},[2058],[383,3814,3816],{"className":3815},[2063,2064,2065,2066],[383,3817,1943],{"className":3818},[1590,2066],[383,3820,2074],{"className":3821},[2073],[383,3823,3825],{"className":3824},[2046],[383,3826,3828],{"className":3827,"style":2081},[2050],[383,3829],{},[383,3831,1674],{"className":3832},[1700],[383,3834],{"className":3835,"style":1704},[1594],[383,3837,3839,3842],{"className":3838},[1590],[383,3840,2910],{"className":3841,"style":3006},[1590,2033],[383,3843,3845],{"className":3844},[2037],[383,3846,3848,3868],{"className":3847},[2041,2042],[383,3849,3851,3865],{"className":3850},[2046],[383,3852,3854],{"className":3853,"style":2051},[2050],[383,3855,3856,3859],{"style":3021},[383,3857],{"className":3858,"style":2059},[2058],[383,3860,3862],{"className":3861},[2063,2064,2065,2066],[383,3863,1563],{"className":3864},[1590,2066],[383,3866,2074],{"className":3867},[2073],[383,3869,3871],{"className":3870},[2046],[383,3872,3874],{"className":3873,"style":2081},[2050],[383,3875],{},[383,3877,1674],{"className":3878},[1700],[383,3880],{"className":3881,"style":1704},[1594],[383,3883,2243],{"className":3884},[1590],[383,3886,1674],{"className":3887},[1700],[383,3889],{"className":3890,"style":1704},[1594],[383,3892,3894,3897],{"className":3893},[1590],[383,3895,2910],{"className":3896,"style":3006},[1590,2033],[383,3898,3900],{"className":3899},[2037],[383,3901,3903,3923],{"className":3902},[2041,2042],[383,3904,3906,3920],{"className":3905},[2046],[383,3907,3909],{"className":3908,"style":2271},[2050],[383,3910,3911,3914],{"style":3021},[383,3912],{"className":3913,"style":2059},[2058],[383,3915,3917],{"className":3916},[2063,2064,2065,2066],[383,3918,11],{"className":3919},[1590,2033,2066],[383,3921,2074],{"className":3922},[2073],[383,3924,3926],{"className":3925},[2046],[383,3927,3929],{"className":3928,"style":3306},[2050],[383,3930],{}," are the coefficients that represent the influence of each feature on the dependent variable.",[37,3933,3934,3963,3964,3992],{},[383,3935,3937,3951],{"className":3936},[1545],[383,3938,3940],{"className":3939},[1549],[1551,3941,3942],{"xmlns":1553},[1555,3943,3944,3948],{},[1558,3945,3946],{},[1938,3947,2969],{},[1569,3949,3950],{"encoding":1571},"\\epsilon",[383,3952,3954],{"className":3953,"ariaHidden":1577},[1576],[383,3955,3957,3960],{"className":3956},[1581],[383,3958],{"className":3959,"style":3364},[1585],[383,3961,2969],{"className":3962},[1590,2033]," is the error or noise value, which represents the variability not explained by the model, that is, what affects ",[383,3965,3967,3980],{"className":3966},[1545],[383,3968,3970],{"className":3969},[1549],[1551,3971,3972],{"xmlns":1553},[1555,3973,3974,3978],{},[1558,3975,3976],{},[1938,3977,1950],{},[1569,3979,1950],{"encoding":1571},[383,3981,3983],{"className":3982,"ariaHidden":1577},[1576],[383,3984,3986,3989],{"className":3985},[1581],[383,3987],{"className":3988,"style":2449},[1585],[383,3990,1950],{"className":3991,"style":2096},[1590,2033]," but is not included in the independent variables.",[11,3994,3995,3996,4025,4026,4054],{},"The objective of the regression model is to find the values of the coefficients ",[383,3997,3999,4013],{"className":3998},[1545],[383,4000,4002],{"className":4001},[1549],[1551,4003,4004],{"xmlns":1553},[1555,4005,4006,4010],{},[1558,4007,4008],{},[1938,4009,2910],{},[1569,4011,4012],{"encoding":1571},"\\beta",[383,4014,4016],{"className":4015,"ariaHidden":1577},[1576],[383,4017,4019,4022],{"className":4018},[1581],[383,4020],{"className":4021,"style":2534},[1585],[383,4023,2910],{"className":4024,"style":3006},[1590,2033]," that minimize the difference between the model's predictions and the real values of ",[383,4027,4029,4042],{"className":4028},[1545],[383,4030,4032],{"className":4031},[1549],[1551,4033,4034],{"xmlns":1553},[1555,4035,4036,4040],{},[1558,4037,4038],{},[1938,4039,1950],{},[1569,4041,1950],{"encoding":1571},[383,4043,4045],{"className":4044,"ariaHidden":1577},[1576],[383,4046,4048,4051],{"className":4047},[1581],[383,4049],{"className":4050,"style":2449},[1585],[383,4052,1950],{"className":4053,"style":2096},[1590,2033],". This can be achieved using techniques such as the least squares method.",[11,4056,4057,4058,4061,4062,4100,4101,4134,4135,4165],{},"The ",[40,4059,4060],{},"intercept"," is represented as the first element of the coefficient vector ",[383,4063,4065,4080],{"className":4064},[1545],[383,4066,4068],{"className":4067},[1549],[1551,4069,4070],{"xmlns":1553},[1555,4071,4072,4077],{},[1558,4073,4074],{},[1938,4075,2910],{"mathvariant":4076},"bold-italic",[1569,4078,4079],{"encoding":1571},"\\boldsymbol{\\beta}",[383,4081,4083],{"className":4082,"ariaHidden":1577},[1576],[383,4084,4086,4089],{"className":4085},[1581],[383,4087],{"className":4088,"style":2534},[1585],[383,4090,4092],{"className":4091},[1590],[383,4093,4095],{"className":4094},[1590],[383,4096,2910],{"className":4097,"style":4099},[1590,4098],"boldsymbol","margin-right:0.034em;",", and it is the value of ",[383,4102,4104,4119],{"className":4103},[1545],[383,4105,4107],{"className":4106},[1549],[1551,4108,4109],{"xmlns":1553},[1555,4110,4111,4116],{},[1558,4112,4113],{},[1938,4114,1950],{"mathvariant":4115},"bold",[1569,4117,4118],{"encoding":1571},"\\mathbf{y}",[383,4120,4122],{"className":4121,"ariaHidden":1577},[1576],[383,4123,4125,4129],{"className":4124},[1581],[383,4126],{"className":4127,"style":4128},[1585],"height:0.6389em;vertical-align:-0.1944em;",[383,4130,1950],{"className":4131,"style":4133},[1590,4132],"mathbf","margin-right:0.016em;"," when all the independent variables in ",[383,4136,4138,4152],{"className":4137},[1545],[383,4139,4141],{"className":4140},[1549],[1551,4142,4143],{"xmlns":1553},[1555,4144,4145,4149],{},[1558,4146,4147],{},[1938,4148,2515],{"mathvariant":4115},[1569,4150,4151],{"encoding":1571},"\\mathbf{X}",[383,4153,4155],{"className":4154,"ariaHidden":1577},[1576],[383,4156,4158,4162],{"className":4157},[1581],[383,4159],{"className":4160,"style":4161},[1585],"height:0.6861em;",[383,4163,2515],{"className":4164},[1590,4132]," are zero, that is, it represents the point where the regression line crosses the Y-axis.",[11,4167,4057,4168,4171,4172,4206,4207,4235,4236,4264],{},[40,4169,4170],{},"slope"," is represented by the remaining coefficients in the vector ",[383,4173,4175,4188],{"className":4174},[1545],[383,4176,4178],{"className":4177},[1549],[1551,4179,4180],{"xmlns":1553},[1555,4181,4182,4186],{},[1558,4183,4184],{},[1938,4185,2910],{"mathvariant":4076},[1569,4187,4079],{"encoding":1571},[383,4189,4191],{"className":4190,"ariaHidden":1577},[1576],[383,4192,4194,4197],{"className":4193},[1581],[383,4195],{"className":4196,"style":2534},[1585],[383,4198,4200],{"className":4199},[1590],[383,4201,4203],{"className":4202},[1590],[383,4204,2910],{"className":4205,"style":4099},[1590,4098],", and each coefficient indicates the amount of change in the dependent variable ",[383,4208,4210,4223],{"className":4209},[1545],[383,4211,4213],{"className":4212},[1549],[1551,4214,4215],{"xmlns":1553},[1555,4216,4217,4221],{},[1558,4218,4219],{},[1938,4220,1950],{"mathvariant":4115},[1569,4222,4118],{"encoding":1571},[383,4224,4226],{"className":4225,"ariaHidden":1577},[1576],[383,4227,4229,4232],{"className":4228},[1581],[383,4230],{"className":4231,"style":4128},[1585],[383,4233,1950],{"className":4234,"style":4133},[1590,4132]," for each unit change in the corresponding independent variable in ",[383,4237,4239,4252],{"className":4238},[1545],[383,4240,4242],{"className":4241},[1549],[1551,4243,4244],{"xmlns":1553},[1555,4245,4246,4250],{},[1558,4247,4248],{},[1938,4249,2515],{"mathvariant":4115},[1569,4251,4151],{"encoding":1571},[383,4253,4255],{"className":4254,"ariaHidden":1577},[1576],[383,4256,4258,4261],{"className":4257},[1581],[383,4259],{"className":4260,"style":4161},[1585],[383,4262,2515],{"className":4263},[1590,4132],", keeping all other independent variables constant.\nGraphically we can see it as follows:",[11,4266,4267,4271],{},[80,4268],{"alt":4269,"src":4270},"Linear regression graph","\u002Fblog\u002Fmachine-learning-paradigms-and-mathematical-foundations\u002Fshared\u002Fregression-model.webp",[85,4272,4273],{},"Linear Regression Graph",[11,4275,4276],{},"Each black point represents a training data point, and the red line represents the model.",[11,4278,4279,4280,4283,4284,4318,4319,4347],{},"The key point here is to understand that ",[40,4281,4282],{},"the main objective"," is to find the values of the coefficients ",[383,4285,4287,4300],{"className":4286},[1545],[383,4288,4290],{"className":4289},[1549],[1551,4291,4292],{"xmlns":1553},[1555,4293,4294,4298],{},[1558,4295,4296],{},[1938,4297,2910],{"mathvariant":4076},[1569,4299,4079],{"encoding":1571},[383,4301,4303],{"className":4302,"ariaHidden":1577},[1576],[383,4304,4306,4309],{"className":4305},[1581],[383,4307],{"className":4308,"style":2534},[1585],[383,4310,4312],{"className":4311},[1590],[383,4313,4315],{"className":4314},[1590],[383,4316,2910],{"className":4317,"style":4099},[1590,4098]," that make the predictions ",[383,4320,4322,4335],{"className":4321},[1545],[383,4323,4325],{"className":4324},[1549],[1551,4326,4327],{"xmlns":1553},[1555,4328,4329,4333],{},[1558,4330,4331],{},[1938,4332,1950],{"mathvariant":4115},[1569,4334,4118],{"encoding":1571},[383,4336,4338],{"className":4337,"ariaHidden":1577},[1576],[383,4339,4341,4344],{"className":4340},[1581],[383,4342],{"className":4343,"style":4128},[1585],[383,4345,1950],{"className":4346,"style":4133},[1590,4132]," (the red line) as close as possible to the actual values.",[11,4349,4350,4351,4387],{},"That is, we do not seek to predict with perfect accuracy, as (in reality) there will always be some error or difference between what the model predicts and what actually happens. The term ",[383,4352,4354,4368],{"className":4353},[1545],[383,4355,4357],{"className":4356},[1549],[1551,4358,4359],{"xmlns":1553},[1555,4360,4361,4365],{},[1558,4362,4363],{},[1938,4364,2969],{"mathvariant":4076},[1569,4366,4367],{"encoding":1571},"\\boldsymbol{\\epsilon}",[383,4369,4371],{"className":4370,"ariaHidden":1577},[1576],[383,4372,4374,4378],{"className":4373},[1581],[383,4375],{"className":4376,"style":4377},[1585],"height:0.4444em;",[383,4379,4381],{"className":4380},[1590],[383,4382,4384],{"className":4383},[1590],[383,4385,2969],{"className":4386},[1590,4098]," is the difference between the values predicted by the model and the actual values:",[383,4389,4391],{"className":4390},[2494],[383,4392,4394,4436],{"className":4393},[1545],[383,4395,4397],{"className":4396},[1549],[1551,4398,4399],{"xmlns":1553,"display":2503},[1555,4400,4401,4433],{},[1558,4402,4403,4411,4413,4419,4421],{},[1938,4404,4405],{},[1935,4406,4407,4409],{},[1938,4408,2969],{"mathvariant":4076},[1938,4410,2363],{"mathvariant":4076},[1565,4412,1567],{},[1935,4414,4415,4417],{},[1938,4416,1950],{"mathvariant":4115},[1938,4418,2363],{"mathvariant":4115},[1565,4420,1680],{},[4422,4423,4424,4430],"mover",{"accent":1577},[1935,4425,4426,4428],{},[1938,4427,1950],{"mathvariant":4115},[1938,4429,2363],{"mathvariant":4115},[1565,4431,4432],{},"^",[1569,4434,4435],{"encoding":1571},"\\boldsymbol{\\epsilon _i} = \\mathbf{y_i} - \\hat{\\mathbf{y_i}}",[383,4437,4439,4502,4560],{"className":4438,"ariaHidden":1577},[1576],[383,4440,4442,4446,4493,4496,4499],{"className":4441},[1581],[383,4443],{"className":4444,"style":4445},[1585],"height:0.5944em;vertical-align:-0.15em;",[383,4447,4449],{"className":4448},[1590],[383,4450,4452],{"className":4451},[1590],[383,4453,4455,4458],{"className":4454},[1590],[383,4456,2969],{"className":4457},[1590,4098],[383,4459,4461],{"className":4460},[2037],[383,4462,4464,4485],{"className":4463},[2041,2042],[383,4465,4467,4482],{"className":4466},[2046],[383,4468,4471],{"className":4469,"style":4470},[2050],"height:0.3353em;",[383,4472,4473,4476],{"style":2054},[383,4474],{"className":4475,"style":2059},[2058],[383,4477,4479],{"className":4478},[2063,2064,2065,2066],[383,4480,2363],{"className":4481},[1590,4098,2066],[383,4483,2074],{"className":4484},[2073],[383,4486,4488],{"className":4487},[2046],[383,4489,4491],{"className":4490,"style":2081},[2050],[383,4492],{},[383,4494],{"className":4495,"style":1595},[1594],[383,4497,1567],{"className":4498},[1599],[383,4500],{"className":4501,"style":1595},[1594],[383,4503,4505,4509,4551,4554,4557],{"className":4504},[1581],[383,4506],{"className":4507,"style":4508},[1585],"height:0.7778em;vertical-align:-0.1944em;",[383,4510,4512,4515],{"className":4511},[1590],[383,4513,1950],{"className":4514,"style":4133},[1590,4132],[383,4516,4518],{"className":4517},[2037],[383,4519,4521,4543],{"className":4520},[2041,2042],[383,4522,4524,4540],{"className":4523},[2046],[383,4525,4528],{"className":4526,"style":4527},[2050],"height:0.3361em;",[383,4529,4531,4534],{"style":4530},"top:-2.55em;margin-left:-0.016em;margin-right:0.05em;",[383,4532],{"className":4533,"style":2059},[2058],[383,4535,4537],{"className":4536},[2063,2064,2065,2066],[383,4538,2363],{"className":4539},[1590,4132,2066],[383,4541,2074],{"className":4542},[2073],[383,4544,4546],{"className":4545},[2046],[383,4547,4549],{"className":4548,"style":2081},[2050],[383,4550],{},[383,4552],{"className":4553,"style":2577},[1594],[383,4555,1680],{"className":4556},[3048],[383,4558],{"className":4559,"style":2577},[1594],[383,4561,4563,4567],{"className":4562},[1581],[383,4564],{"className":4565,"style":4566},[1585],"height:0.9023em;vertical-align:-0.1944em;",[383,4568,4571],{"className":4569},[1590,4570],"accent",[383,4572,4574,4645],{"className":4573},[2041,2042],[383,4575,4577,4642],{"className":4576},[2046],[383,4578,4581,4628],{"className":4579,"style":4580},[2050],"height:0.7079em;",[383,4582,4584,4588],{"style":4583},"top:-3em;",[383,4585],{"className":4586,"style":4587},[2058],"height:3em;",[383,4589,4591,4594],{"className":4590},[1590],[383,4592,1950],{"className":4593,"style":4133},[1590,4132],[383,4595,4597],{"className":4596},[2037],[383,4598,4600,4620],{"className":4599},[2041,2042],[383,4601,4603,4617],{"className":4602},[2046],[383,4604,4606],{"className":4605,"style":4527},[2050],[383,4607,4608,4611],{"style":4530},[383,4609],{"className":4610,"style":2059},[2058],[383,4612,4614],{"className":4613},[2063,2064,2065,2066],[383,4615,2363],{"className":4616},[1590,4132,2066],[383,4618,2074],{"className":4619},[2073],[383,4621,4623],{"className":4622},[2046],[383,4624,4626],{"className":4625,"style":2081},[2050],[383,4627],{},[383,4629,4631,4634],{"style":4630},"top:-3.0134em;",[383,4632],{"className":4633,"style":4587},[2058],[383,4635,4639],{"className":4636,"style":4638},[4637],"accent-body","left:-0.25em;",[383,4640,4432],{"className":4641},[1590],[383,4643,2074],{"className":4644},[2073],[383,4646,4648],{"className":4647},[2046],[383,4649,4652],{"className":4650,"style":4651},[2050],"height:0.1944em;",[383,4653],{},[11,4655,4656],{},"Which can also be expressed as:",[383,4658,4660],{"className":4659},[2494],[383,4661,4663,4719],{"className":4662},[1545],[383,4664,4666],{"className":4665},[1549],[1551,4667,4668],{"xmlns":1553,"display":2503},[1555,4669,4670,4716],{},[1558,4671,4672,4680,4682,4688,4690,4692,4700,4702,4708,4714],{},[1938,4673,4674],{},[1935,4675,4676,4678],{},[1938,4677,2969],{"mathvariant":4076},[1938,4679,2363],{"mathvariant":4076},[1565,4681,1567],{},[1935,4683,4684,4686],{},[1938,4685,1950],{"mathvariant":4115},[1938,4687,2363],{"mathvariant":4115},[1565,4689,1680],{},[1565,4691,1933],{"stretchy":1929},[1938,4693,4694],{},[1935,4695,4696,4698],{},[1938,4697,2910],{"mathvariant":4076},[1561,4699,2913],{"mathvariant":4115},[1565,4701,2916],{},[1935,4703,4704,4706],{},[1938,4705,2910],{},[1561,4707,1943],{},[1935,4709,4710,4712],{},[1938,4711,1940],{},[1938,4713,2363],{},[1565,4715,1955],{"stretchy":1929},[1569,4717,4718],{"encoding":1571},"\\boldsymbol{\\epsilon _i} = \\mathbf{y_i} - (\\boldsymbol{\\beta_0} + \\beta_1 x_{i})",[383,4720,4722,4783,4838,4903],{"className":4721,"ariaHidden":1577},[1576],[383,4723,4725,4728,4774,4777,4780],{"className":4724},[1581],[383,4726],{"className":4727,"style":4445},[1585],[383,4729,4731],{"className":4730},[1590],[383,4732,4734],{"className":4733},[1590],[383,4735,4737,4740],{"className":4736},[1590],[383,4738,2969],{"className":4739},[1590,4098],[383,4741,4743],{"className":4742},[2037],[383,4744,4746,4766],{"className":4745},[2041,2042],[383,4747,4749,4763],{"className":4748},[2046],[383,4750,4752],{"className":4751,"style":4470},[2050],[383,4753,4754,4757],{"style":2054},[383,4755],{"className":4756,"style":2059},[2058],[383,4758,4760],{"className":4759},[2063,2064,2065,2066],[383,4761,2363],{"className":4762},[1590,4098,2066],[383,4764,2074],{"className":4765},[2073],[383,4767,4769],{"className":4768},[2046],[383,4770,4772],{"className":4771,"style":2081},[2050],[383,4773],{},[383,4775],{"className":4776,"style":1595},[1594],[383,4778,1567],{"className":4779},[1599],[383,4781],{"className":4782,"style":1595},[1594],[383,4784,4786,4789,4829,4832,4835],{"className":4785},[1581],[383,4787],{"className":4788,"style":4508},[1585],[383,4790,4792,4795],{"className":4791},[1590],[383,4793,1950],{"className":4794,"style":4133},[1590,4132],[383,4796,4798],{"className":4797},[2037],[383,4799,4801,4821],{"className":4800},[2041,2042],[383,4802,4804,4818],{"className":4803},[2046],[383,4805,4807],{"className":4806,"style":4527},[2050],[383,4808,4809,4812],{"style":4530},[383,4810],{"className":4811,"style":2059},[2058],[383,4813,4815],{"className":4814},[2063,2064,2065,2066],[383,4816,2363],{"className":4817},[1590,4132,2066],[383,4819,2074],{"className":4820},[2073],[383,4822,4824],{"className":4823},[2046],[383,4825,4827],{"className":4826,"style":2081},[2050],[383,4828],{},[383,4830],{"className":4831,"style":2577},[1594],[383,4833,1680],{"className":4834},[3048],[383,4836],{"className":4837,"style":2577},[1594],[383,4839,4841,4844,4847,4894,4897,4900],{"className":4840},[1581],[383,4842],{"className":4843,"style":2021},[1585],[383,4845,1933],{"className":4846},[2025],[383,4848,4850],{"className":4849},[1590],[383,4851,4853],{"className":4852},[1590],[383,4854,4856,4859],{"className":4855},[1590],[383,4857,2910],{"className":4858,"style":4099},[1590,4098],[383,4860,4862],{"className":4861},[2037],[383,4863,4865,4886],{"className":4864},[2041,2042],[383,4866,4868,4883],{"className":4867},[2046],[383,4869,4871],{"className":4870,"style":2051},[2050],[383,4872,4874,4877],{"style":4873},"top:-2.55em;margin-left:-0.034em;margin-right:0.05em;",[383,4875],{"className":4876,"style":2059},[2058],[383,4878,4880],{"className":4879},[2063,2064,2065,2066],[383,4881,2913],{"className":4882},[1590,4132,2066],[383,4884,2074],{"className":4885},[2073],[383,4887,4889],{"className":4888},[2046],[383,4890,4892],{"className":4891,"style":2081},[2050],[383,4893],{},[383,4895],{"className":4896,"style":2577},[1594],[383,4898,2916],{"className":4899},[3048],[383,4901],{"className":4902,"style":2577},[1594],[383,4904,4906,4909,4949,4992],{"className":4905},[1581],[383,4907],{"className":4908,"style":2021},[1585],[383,4910,4912,4915],{"className":4911},[1590],[383,4913,2910],{"className":4914,"style":3006},[1590,2033],[383,4916,4918],{"className":4917},[2037],[383,4919,4921,4941],{"className":4920},[2041,2042],[383,4922,4924,4938],{"className":4923},[2046],[383,4925,4927],{"className":4926,"style":2051},[2050],[383,4928,4929,4932],{"style":3021},[383,4930],{"className":4931,"style":2059},[2058],[383,4933,4935],{"className":4934},[2063,2064,2065,2066],[383,4936,1943],{"className":4937},[1590,2066],[383,4939,2074],{"className":4940},[2073],[383,4942,4944],{"className":4943},[2046],[383,4945,4947],{"className":4946,"style":2081},[2050],[383,4948],{},[383,4950,4952,4955],{"className":4951},[1590],[383,4953,1940],{"className":4954},[1590,2033],[383,4956,4958],{"className":4957},[2037],[383,4959,4961,4984],{"className":4960},[2041,2042],[383,4962,4964,4981],{"className":4963},[2046],[383,4965,4967],{"className":4966,"style":2395},[2050],[383,4968,4969,4972],{"style":2054},[383,4970],{"className":4971,"style":2059},[2058],[383,4973,4975],{"className":4974},[2063,2064,2065,2066],[383,4976,4978],{"className":4977},[1590,2066],[383,4979,2363],{"className":4980},[1590,2033,2066],[383,4982,2074],{"className":4983},[2073],[383,4985,4987],{"className":4986},[2046],[383,4988,4990],{"className":4989,"style":2081},[2050],[383,4991],{},[383,4993,1955],{"className":4994},[2135],[11,4996,4997],{},"To measure the error we can use a loss function. In the case of linear regression, a commonly used loss function is the mean squared error (MSE, for its acronym in English), which is defined as:",[383,4999,5001],{"className":5000},[2494],[383,5002,5004,5077],{"className":5003},[1545],[383,5005,5007],{"className":5006},[1549],[1551,5008,5009],{"xmlns":1553,"display":2503},[1555,5010,5011,5074],{},[1558,5012,5013,5016,5019,5022,5024,5031,5047,5049,5055,5057,5067],{},[1938,5014,5015],{},"M",[1938,5017,5018],{},"S",[1938,5020,5021],{},"E",[1565,5023,1567],{},[5025,5026,5027,5029],"mfrac",{},[1561,5028,1943],{},[1938,5030,1995],{},[5032,5033,5034,5037,5045],"munderover",{},[1565,5035,5036],{},"∑",[1558,5038,5039,5041,5043],{},[1938,5040,2363],{},[1565,5042,1567],{},[1561,5044,1943],{},[1938,5046,1995],{},[1565,5048,1933],{"stretchy":1929},[1935,5050,5051,5053],{},[1938,5052,1950],{},[1938,5054,2363],{},[1565,5056,1680],{},[4422,5058,5059,5065],{"accent":1577},[1935,5060,5061,5063],{},[1938,5062,1950],{},[1938,5064,2363],{},[1565,5066,4432],{},[5068,5069,5070,5072],"msup",{},[1565,5071,1955],{"stretchy":1929},[1561,5073,1563],{},[1569,5075,5076],{"encoding":1571},"MSE = \\frac{1}{n} \\sum_{i=1}^{n} (y_i - \\hat{y_i})^2",[383,5078,5080,5106,5315],{"className":5079,"ariaHidden":1577},[1576],[383,5081,5083,5086,5090,5094,5097,5100,5103],{"className":5082},[1581],[383,5084],{"className":5085,"style":2554},[1585],[383,5087,5015],{"className":5088,"style":5089},[1590,2033],"margin-right:0.109em;",[383,5091,5018],{"className":5092,"style":5093},[1590,2033],"margin-right:0.0576em;",[383,5095,5021],{"className":5096,"style":5093},[1590,2033],[383,5098],{"className":5099,"style":1595},[1594],[383,5101,1567],{"className":5102},[1599],[383,5104],{"className":5105,"style":1595},[1594],[383,5107,5109,5113,5183,5186,5263,5266,5306,5309,5312],{"className":5108},[1581],[383,5110],{"className":5111,"style":5112},[1585],"height:2.9291em;vertical-align:-1.2777em;",[383,5114,5116,5120,5180],{"className":5115},[1590],[383,5117],{"className":5118},[2025,5119],"nulldelimiter",[383,5121,5123],{"className":5122},[5025],[383,5124,5126,5171],{"className":5125},[2041,2042],[383,5127,5129,5168],{"className":5128},[2046],[383,5130,5133,5145,5156],{"className":5131,"style":5132},[2050],"height:1.3214em;",[383,5134,5136,5139],{"style":5135},"top:-2.314em;",[383,5137],{"className":5138,"style":4587},[2058],[383,5140,5142],{"className":5141},[1590],[383,5143,1995],{"className":5144},[1590,2033],[383,5146,5148,5151],{"style":5147},"top:-3.23em;",[383,5149],{"className":5150,"style":4587},[2058],[383,5152],{"className":5153,"style":5155},[5154],"frac-line","border-bottom-width:0.04em;",[383,5157,5159,5162],{"style":5158},"top:-3.677em;",[383,5160],{"className":5161,"style":4587},[2058],[383,5163,5165],{"className":5164},[1590],[383,5166,1943],{"className":5167},[1590],[383,5169,2074],{"className":5170},[2073],[383,5172,5174],{"className":5173},[2046],[383,5175,5178],{"className":5176,"style":5177},[2050],"height:0.686em;",[383,5179],{},[383,5181],{"className":5182},[2135,5119],[383,5184],{"className":5185,"style":1704},[1594],[383,5187,5191],{"className":5188},[5189,5190],"mop","op-limits",[383,5192,5194,5254],{"className":5193},[2041,2042],[383,5195,5197,5251],{"className":5196},[2046],[383,5198,5201,5223,5236],{"className":5199,"style":5200},[2050],"height:1.6514em;",[383,5202,5204,5208],{"style":5203},"top:-1.8723em;margin-left:0em;",[383,5205],{"className":5206,"style":5207},[2058],"height:3.05em;",[383,5209,5211],{"className":5210},[2063,2064,2065,2066],[383,5212,5214,5217,5220],{"className":5213},[1590,2066],[383,5215,2363],{"className":5216},[1590,2033,2066],[383,5218,1567],{"className":5219},[1599,2066],[383,5221,1943],{"className":5222},[1590,2066],[383,5224,5226,5229],{"style":5225},"top:-3.05em;",[383,5227],{"className":5228,"style":5207},[2058],[383,5230,5231],{},[383,5232,5036],{"className":5233},[5189,5234,5235],"op-symbol","large-op",[383,5237,5239,5242],{"style":5238},"top:-4.3em;margin-left:0em;",[383,5240],{"className":5241,"style":5207},[2058],[383,5243,5245],{"className":5244},[2063,2064,2065,2066],[383,5246,5248],{"className":5247},[1590,2066],[383,5249,1995],{"className":5250},[1590,2033,2066],[383,5252,2074],{"className":5253},[2073],[383,5255,5257],{"className":5256},[2046],[383,5258,5261],{"className":5259,"style":5260},[2050],"height:1.2777em;",[383,5262],{},[383,5264,1933],{"className":5265},[2025],[383,5267,5269,5272],{"className":5268},[1590],[383,5270,1950],{"className":5271,"style":2096},[1590,2033],[383,5273,5275],{"className":5274},[2037],[383,5276,5278,5298],{"className":5277},[2041,2042],[383,5279,5281,5295],{"className":5280},[2046],[383,5282,5284],{"className":5283,"style":2395},[2050],[383,5285,5286,5289],{"style":2111},[383,5287],{"className":5288,"style":2059},[2058],[383,5290,5292],{"className":5291},[2063,2064,2065,2066],[383,5293,2363],{"className":5294},[1590,2033,2066],[383,5296,2074],{"className":5297},[2073],[383,5299,5301],{"className":5300},[2046],[383,5302,5304],{"className":5303,"style":2081},[2050],[383,5305],{},[383,5307],{"className":5308,"style":2577},[1594],[383,5310,1680],{"className":5311},[3048],[383,5313],{"className":5314,"style":2577},[1594],[383,5316,5318,5322,5402],{"className":5317},[1581],[383,5319],{"className":5320,"style":5321},[1585],"height:1.1141em;vertical-align:-0.25em;",[383,5323,5325],{"className":5324},[1590,4570],[383,5326,5328,5394],{"className":5327},[2041,2042],[383,5329,5331,5391],{"className":5330},[2046],[383,5332,5335,5380],{"className":5333,"style":5334},[2050],"height:0.6944em;",[383,5336,5337,5340],{"style":4583},[383,5338],{"className":5339,"style":4587},[2058],[383,5341,5343,5346],{"className":5342},[1590],[383,5344,1950],{"className":5345,"style":2096},[1590,2033],[383,5347,5349],{"className":5348},[2037],[383,5350,5352,5372],{"className":5351},[2041,2042],[383,5353,5355,5369],{"className":5354},[2046],[383,5356,5358],{"className":5357,"style":2395},[2050],[383,5359,5360,5363],{"style":2111},[383,5361],{"className":5362,"style":2059},[2058],[383,5364,5366],{"className":5365},[2063,2064,2065,2066],[383,5367,2363],{"className":5368},[1590,2033,2066],[383,5370,2074],{"className":5371},[2073],[383,5373,5375],{"className":5374},[2046],[383,5376,5378],{"className":5377,"style":2081},[2050],[383,5379],{},[383,5381,5382,5385],{"style":4583},[383,5383],{"className":5384,"style":4587},[2058],[383,5386,5388],{"className":5387,"style":4638},[4637],[383,5389,4432],{"className":5390},[1590],[383,5392,2074],{"className":5393},[2073],[383,5395,5397],{"className":5396},[2046],[383,5398,5400],{"className":5399,"style":4651},[2050],[383,5401],{},[383,5403,5405,5408],{"className":5404},[2135],[383,5406,1955],{"className":5407},[2135],[383,5409,5411],{"className":5410},[2037],[383,5412,5414],{"className":5413},[2041],[383,5415,5417],{"className":5416},[2046],[383,5418,5421],{"className":5419,"style":5420},[2050],"height:0.8641em;",[383,5422,5424,5427],{"style":5423},"top:-3.113em;margin-right:0.05em;",[383,5425],{"className":5426,"style":2059},[2058],[383,5428,5430],{"className":5429},[2063,2064,2065,2066],[383,5431,1563],{"className":5432},[1590,2066],[11,5434,3370],{},[34,5436,5437,5468,5569],{},[37,5438,5439,5467],{},[383,5440,5442,5455],{"className":5441},[1545],[383,5443,5445],{"className":5444},[1549],[1551,5446,5447],{"xmlns":1553},[1555,5448,5449,5453],{},[1558,5450,5451],{},[1938,5452,1995],{},[1569,5454,1995],{"encoding":1571},[383,5456,5458],{"className":5457,"ariaHidden":1577},[1576],[383,5459,5461,5464],{"className":5460},[1581],[383,5462],{"className":5463,"style":3364},[1585],[383,5465,1995],{"className":5466},[1590,2033]," is the number of examples in the dataset.",[37,5469,5470,5539,5540,1497],{},[383,5471,5473,5490],{"className":5472},[1545],[383,5474,5476],{"className":5475},[1549],[1551,5477,5478],{"xmlns":1553},[1555,5479,5480,5488],{},[1558,5481,5482],{},[1935,5483,5484,5486],{},[1938,5485,1950],{},[1938,5487,2363],{},[1569,5489,2439],{"encoding":1571},[383,5491,5493],{"className":5492,"ariaHidden":1577},[1576],[383,5494,5496,5499],{"className":5495},[1581],[383,5497],{"className":5498,"style":2449},[1585],[383,5500,5502,5505],{"className":5501},[1590],[383,5503,1950],{"className":5504,"style":2096},[1590,2033],[383,5506,5508],{"className":5507},[2037],[383,5509,5511,5531],{"className":5510},[2041,2042],[383,5512,5514,5528],{"className":5513},[2046],[383,5515,5517],{"className":5516,"style":2395},[2050],[383,5518,5519,5522],{"style":2111},[383,5520],{"className":5521,"style":2059},[2058],[383,5523,5525],{"className":5524},[2063,2064,2065,2066],[383,5526,2363],{"className":5527},[1590,2033,2066],[383,5529,2074],{"className":5530},[2073],[383,5532,5534],{"className":5533},[2046],[383,5535,5537],{"className":5536,"style":2081},[2050],[383,5538],{}," is the actual value of the dependent variable for example ",[383,5541,5543,5556],{"className":5542},[1545],[383,5544,5546],{"className":5545},[1549],[1551,5547,5548],{"xmlns":1553},[1555,5549,5550,5554],{},[1558,5551,5552],{},[1938,5553,2363],{},[1569,5555,2363],{"encoding":1571},[383,5557,5559],{"className":5558,"ariaHidden":1577},[1576],[383,5560,5562,5566],{"className":5561},[1581],[383,5563],{"className":5564,"style":5565},[1585],"height:0.6595em;",[383,5567,2363],{"className":5568},[1590,2033],[37,5570,5571,5685,5686,1497],{},[383,5572,5574,5596],{"className":5573},[1545],[383,5575,5577],{"className":5576},[1549],[1551,5578,5579],{"xmlns":1553},[1555,5580,5581,5593],{},[1558,5582,5583],{},[1935,5584,5585,5591],{},[4422,5586,5587,5589],{"accent":1577},[1938,5588,1950],{},[1565,5590,4432],{},[1938,5592,2363],{},[1569,5594,5595],{"encoding":1571},"\\hat{y}_i",[383,5597,5599],{"className":5598,"ariaHidden":1577},[1576],[383,5600,5602,5605],{"className":5601},[1581],[383,5603],{"className":5604,"style":2534},[1585],[383,5606,5608,5651],{"className":5607},[1590],[383,5609,5611],{"className":5610},[1590,4570],[383,5612,5614,5643],{"className":5613},[2041,2042],[383,5615,5617,5640],{"className":5616},[2046],[383,5618,5620,5628],{"className":5619,"style":5334},[2050],[383,5621,5622,5625],{"style":4583},[383,5623],{"className":5624,"style":4587},[2058],[383,5626,1950],{"className":5627,"style":2096},[1590,2033],[383,5629,5630,5633],{"style":4583},[383,5631],{"className":5632,"style":4587},[2058],[383,5634,5637],{"className":5635,"style":5636},[4637],"left:-0.1944em;",[383,5638,4432],{"className":5639},[1590],[383,5641,2074],{"className":5642},[2073],[383,5644,5646],{"className":5645},[2046],[383,5647,5649],{"className":5648,"style":4651},[2050],[383,5650],{},[383,5652,5654],{"className":5653},[2037],[383,5655,5657,5677],{"className":5656},[2041,2042],[383,5658,5660,5674],{"className":5659},[2046],[383,5661,5663],{"className":5662,"style":2395},[2050],[383,5664,5665,5668],{"style":2111},[383,5666],{"className":5667,"style":2059},[2058],[383,5669,5671],{"className":5670},[2063,2064,2065,2066],[383,5672,2363],{"className":5673},[1590,2033,2066],[383,5675,2074],{"className":5676},[2073],[383,5678,5680],{"className":5679},[2046],[383,5681,5683],{"className":5682,"style":2081},[2050],[383,5684],{}," is the model's prediction for example ",[383,5687,5689,5702],{"className":5688},[1545],[383,5690,5692],{"className":5691},[1549],[1551,5693,5694],{"xmlns":1553},[1555,5695,5696,5700],{},[1558,5697,5698],{},[1938,5699,2363],{},[1569,5701,2363],{"encoding":1571},[383,5703,5705],{"className":5704,"ariaHidden":1577},[1576],[383,5706,5708,5711],{"className":5707},[1581],[383,5709],{"className":5710,"style":5565},[1585],[383,5712,2363],{"className":5713},[1590,2033],[11,5715,5716],{},"Minimizing the MSE is equivalent to minimizing the sum of squared errors:",[383,5718,5720],{"className":5719},[2494],[383,5721,5723,5775],{"className":5722},[1545],[383,5724,5726],{"className":5725},[1549],[1551,5727,5728],{"xmlns":1553,"display":2503},[1555,5729,5730,5772],{},[1558,5731,5732,5746,5748,5754,5756,5766],{},[5032,5733,5734,5736,5744],{},[1565,5735,5036],{},[1558,5737,5738,5740,5742],{},[1938,5739,2363],{},[1565,5741,1567],{},[1561,5743,1943],{},[1938,5745,1995],{},[1565,5747,1933],{"stretchy":1929},[1935,5749,5750,5752],{},[1938,5751,1950],{},[1938,5753,2363],{},[1565,5755,1680],{},[4422,5757,5758,5764],{"accent":1577},[1935,5759,5760,5762],{},[1938,5761,1950],{},[1938,5763,2363],{},[1565,5765,4432],{},[5068,5767,5768,5770],{},[1565,5769,1955],{"stretchy":1929},[1561,5771,1563],{},[1569,5773,5774],{"encoding":1571},"\\sum_{i=1}^{n} (y_i - \\hat{y_i})^2",[383,5776,5778,5903],{"className":5777,"ariaHidden":1577},[1576],[383,5779,5781,5784,5851,5854,5894,5897,5900],{"className":5780},[1581],[383,5782],{"className":5783,"style":5112},[1585],[383,5785,5787],{"className":5786},[5189,5190],[383,5788,5790,5843],{"className":5789},[2041,2042],[383,5791,5793,5840],{"className":5792},[2046],[383,5794,5796,5816,5826],{"className":5795,"style":5200},[2050],[383,5797,5798,5801],{"style":5203},[383,5799],{"className":5800,"style":5207},[2058],[383,5802,5804],{"className":5803},[2063,2064,2065,2066],[383,5805,5807,5810,5813],{"className":5806},[1590,2066],[383,5808,2363],{"className":5809},[1590,2033,2066],[383,5811,1567],{"className":5812},[1599,2066],[383,5814,1943],{"className":5815},[1590,2066],[383,5817,5818,5821],{"style":5225},[383,5819],{"className":5820,"style":5207},[2058],[383,5822,5823],{},[383,5824,5036],{"className":5825},[5189,5234,5235],[383,5827,5828,5831],{"style":5238},[383,5829],{"className":5830,"style":5207},[2058],[383,5832,5834],{"className":5833},[2063,2064,2065,2066],[383,5835,5837],{"className":5836},[1590,2066],[383,5838,1995],{"className":5839},[1590,2033,2066],[383,5841,2074],{"className":5842},[2073],[383,5844,5846],{"className":5845},[2046],[383,5847,5849],{"className":5848,"style":5260},[2050],[383,5850],{},[383,5852,1933],{"className":5853},[2025],[383,5855,5857,5860],{"className":5856},[1590],[383,5858,1950],{"className":5859,"style":2096},[1590,2033],[383,5861,5863],{"className":5862},[2037],[383,5864,5866,5886],{"className":5865},[2041,2042],[383,5867,5869,5883],{"className":5868},[2046],[383,5870,5872],{"className":5871,"style":2395},[2050],[383,5873,5874,5877],{"style":2111},[383,5875],{"className":5876,"style":2059},[2058],[383,5878,5880],{"className":5879},[2063,2064,2065,2066],[383,5881,2363],{"className":5882},[1590,2033,2066],[383,5884,2074],{"className":5885},[2073],[383,5887,5889],{"className":5888},[2046],[383,5890,5892],{"className":5891,"style":2081},[2050],[383,5893],{},[383,5895],{"className":5896,"style":2577},[1594],[383,5898,1680],{"className":5899},[3048],[383,5901],{"className":5902,"style":2577},[1594],[383,5904,5906,5909,5988],{"className":5905},[1581],[383,5907],{"className":5908,"style":5321},[1585],[383,5910,5912],{"className":5911},[1590,4570],[383,5913,5915,5980],{"className":5914},[2041,2042],[383,5916,5918,5977],{"className":5917},[2046],[383,5919,5921,5966],{"className":5920,"style":5334},[2050],[383,5922,5923,5926],{"style":4583},[383,5924],{"className":5925,"style":4587},[2058],[383,5927,5929,5932],{"className":5928},[1590],[383,5930,1950],{"className":5931,"style":2096},[1590,2033],[383,5933,5935],{"className":5934},[2037],[383,5936,5938,5958],{"className":5937},[2041,2042],[383,5939,5941,5955],{"className":5940},[2046],[383,5942,5944],{"className":5943,"style":2395},[2050],[383,5945,5946,5949],{"style":2111},[383,5947],{"className":5948,"style":2059},[2058],[383,5950,5952],{"className":5951},[2063,2064,2065,2066],[383,5953,2363],{"className":5954},[1590,2033,2066],[383,5956,2074],{"className":5957},[2073],[383,5959,5961],{"className":5960},[2046],[383,5962,5964],{"className":5963,"style":2081},[2050],[383,5965],{},[383,5967,5968,5971],{"style":4583},[383,5969],{"className":5970,"style":4587},[2058],[383,5972,5974],{"className":5973,"style":4638},[4637],[383,5975,4432],{"className":5976},[1590],[383,5978,2074],{"className":5979},[2073],[383,5981,5983],{"className":5982},[2046],[383,5984,5986],{"className":5985,"style":4651},[2050],[383,5987],{},[383,5989,5991,5994],{"className":5990},[2135],[383,5992,1955],{"className":5993},[2135],[383,5995,5997],{"className":5996},[2037],[383,5998,6000],{"className":5999},[2041],[383,6001,6003],{"className":6002},[2046],[383,6004,6006],{"className":6005,"style":5420},[2050],[383,6007,6008,6011],{"style":5423},[383,6009],{"className":6010,"style":2059},[2058],[383,6012,6014],{"className":6013},[2063,2064,2065,2066],[383,6015,1563],{"className":6016},[1590,2066],[11,6018,6019],{},"Or also:",[383,6021,6023],{"className":6022},[2494],[383,6024,6026,6092],{"className":6025},[1545],[383,6027,6029],{"className":6028},[1549],[1551,6030,6031],{"xmlns":1553,"display":2503},[1555,6032,6033,6089],{},[1558,6034,6035,6049,6051,6057,6059,6061,6067,6069,6075,6081,6083],{},[5032,6036,6037,6039,6047],{},[1565,6038,5036],{},[1558,6040,6041,6043,6045],{},[1938,6042,2363],{},[1565,6044,1567],{},[1561,6046,1943],{},[1938,6048,1995],{},[1565,6050,1933],{"stretchy":1929},[1935,6052,6053,6055],{},[1938,6054,1950],{},[1938,6056,2363],{},[1565,6058,1680],{},[1565,6060,1933],{"stretchy":1929},[1935,6062,6063,6065],{},[1938,6064,2910],{},[1561,6066,2913],{},[1565,6068,2916],{},[1935,6070,6071,6073],{},[1938,6072,2910],{},[1561,6074,1943],{},[1935,6076,6077,6079],{},[1938,6078,1940],{},[1938,6080,2363],{},[1565,6082,1955],{"stretchy":1929},[5068,6084,6085,6087],{},[1565,6086,1955],{"stretchy":1929},[1561,6088,1563],{},[1569,6090,6091],{"encoding":1571},"\\sum_{i=1}^{n} (y_i - (\\beta_0 + \\beta_1 x_i))^2",[383,6093,6095,6220,6278],{"className":6094,"ariaHidden":1577},[1576],[383,6096,6098,6101,6168,6171,6211,6214,6217],{"className":6097},[1581],[383,6099],{"className":6100,"style":5112},[1585],[383,6102,6104],{"className":6103},[5189,5190],[383,6105,6107,6160],{"className":6106},[2041,2042],[383,6108,6110,6157],{"className":6109},[2046],[383,6111,6113,6133,6143],{"className":6112,"style":5200},[2050],[383,6114,6115,6118],{"style":5203},[383,6116],{"className":6117,"style":5207},[2058],[383,6119,6121],{"className":6120},[2063,2064,2065,2066],[383,6122,6124,6127,6130],{"className":6123},[1590,2066],[383,6125,2363],{"className":6126},[1590,2033,2066],[383,6128,1567],{"className":6129},[1599,2066],[383,6131,1943],{"className":6132},[1590,2066],[383,6134,6135,6138],{"style":5225},[383,6136],{"className":6137,"style":5207},[2058],[383,6139,6140],{},[383,6141,5036],{"className":6142},[5189,5234,5235],[383,6144,6145,6148],{"style":5238},[383,6146],{"className":6147,"style":5207},[2058],[383,6149,6151],{"className":6150},[2063,2064,2065,2066],[383,6152,6154],{"className":6153},[1590,2066],[383,6155,1995],{"className":6156},[1590,2033,2066],[383,6158,2074],{"className":6159},[2073],[383,6161,6163],{"className":6162},[2046],[383,6164,6166],{"className":6165,"style":5260},[2050],[383,6167],{},[383,6169,1933],{"className":6170},[2025],[383,6172,6174,6177],{"className":6173},[1590],[383,6175,1950],{"className":6176,"style":2096},[1590,2033],[383,6178,6180],{"className":6179},[2037],[383,6181,6183,6203],{"className":6182},[2041,2042],[383,6184,6186,6200],{"className":6185},[2046],[383,6187,6189],{"className":6188,"style":2395},[2050],[383,6190,6191,6194],{"style":2111},[383,6192],{"className":6193,"style":2059},[2058],[383,6195,6197],{"className":6196},[2063,2064,2065,2066],[383,6198,2363],{"className":6199},[1590,2033,2066],[383,6201,2074],{"className":6202},[2073],[383,6204,6206],{"className":6205},[2046],[383,6207,6209],{"className":6208,"style":2081},[2050],[383,6210],{},[383,6212],{"className":6213,"style":2577},[1594],[383,6215,1680],{"className":6216},[3048],[383,6218],{"className":6219,"style":2577},[1594],[383,6221,6223,6226,6229,6269,6272,6275],{"className":6222},[1581],[383,6224],{"className":6225,"style":2021},[1585],[383,6227,1933],{"className":6228},[2025],[383,6230,6232,6235],{"className":6231},[1590],[383,6233,2910],{"className":6234,"style":3006},[1590,2033],[383,6236,6238],{"className":6237},[2037],[383,6239,6241,6261],{"className":6240},[2041,2042],[383,6242,6244,6258],{"className":6243},[2046],[383,6245,6247],{"className":6246,"style":2051},[2050],[383,6248,6249,6252],{"style":3021},[383,6250],{"className":6251,"style":2059},[2058],[383,6253,6255],{"className":6254},[2063,2064,2065,2066],[383,6256,2913],{"className":6257},[1590,2066],[383,6259,2074],{"className":6260},[2073],[383,6262,6264],{"className":6263},[2046],[383,6265,6267],{"className":6266,"style":2081},[2050],[383,6268],{},[383,6270],{"className":6271,"style":2577},[1594],[383,6273,2916],{"className":6274},[3048],[383,6276],{"className":6277,"style":2577},[1594],[383,6279,6281,6284,6324,6364,6367],{"className":6280},[1581],[383,6282],{"className":6283,"style":5321},[1585],[383,6285,6287,6290],{"className":6286},[1590],[383,6288,2910],{"className":6289,"style":3006},[1590,2033],[383,6291,6293],{"className":6292},[2037],[383,6294,6296,6316],{"className":6295},[2041,2042],[383,6297,6299,6313],{"className":6298},[2046],[383,6300,6302],{"className":6301,"style":2051},[2050],[383,6303,6304,6307],{"style":3021},[383,6305],{"className":6306,"style":2059},[2058],[383,6308,6310],{"className":6309},[2063,2064,2065,2066],[383,6311,1943],{"className":6312},[1590,2066],[383,6314,2074],{"className":6315},[2073],[383,6317,6319],{"className":6318},[2046],[383,6320,6322],{"className":6321,"style":2081},[2050],[383,6323],{},[383,6325,6327,6330],{"className":6326},[1590],[383,6328,1940],{"className":6329},[1590,2033],[383,6331,6333],{"className":6332},[2037],[383,6334,6336,6356],{"className":6335},[2041,2042],[383,6337,6339,6353],{"className":6338},[2046],[383,6340,6342],{"className":6341,"style":2395},[2050],[383,6343,6344,6347],{"style":2054},[383,6345],{"className":6346,"style":2059},[2058],[383,6348,6350],{"className":6349},[2063,2064,2065,2066],[383,6351,2363],{"className":6352},[1590,2033,2066],[383,6354,2074],{"className":6355},[2073],[383,6357,6359],{"className":6358},[2046],[383,6360,6362],{"className":6361,"style":2081},[2050],[383,6363],{},[383,6365,1955],{"className":6366},[2135],[383,6368,6370,6373],{"className":6369},[2135],[383,6371,1955],{"className":6372},[2135],[383,6374,6376],{"className":6375},[2037],[383,6377,6379],{"className":6378},[2041],[383,6380,6382],{"className":6381},[2046],[383,6383,6385],{"className":6384,"style":5420},[2050],[383,6386,6387,6390],{"style":5423},[383,6388],{"className":6389,"style":2059},[2058],[383,6391,6393],{"className":6392},[2063,2064,2065,2066],[383,6394,1563],{"className":6395},[1590,2066],[11,6397,6398,6399,6402,6403,6437],{},"This is known as the ",[40,6400,6401],{},"least squares method",", and it is a commonly used technique to find the coefficients ",[383,6404,6406,6419],{"className":6405},[1545],[383,6407,6409],{"className":6408},[1549],[1551,6410,6411],{"xmlns":1553},[1555,6412,6413,6417],{},[1558,6414,6415],{},[1938,6416,2910],{"mathvariant":4076},[1569,6418,4079],{"encoding":1571},[383,6420,6422],{"className":6421,"ariaHidden":1577},[1576],[383,6423,6425,6428],{"className":6424},[1581],[383,6426],{"className":6427,"style":2534},[1585],[383,6429,6431],{"className":6430},[1590],[383,6432,6434],{"className":6433},[1590],[383,6435,2910],{"className":6436,"style":4099},[1590,4098]," that best fit the data.",[293,6439,6440],{},[11,6441,6442],{},"Why are squares used? Because by squaring the differences, larger errors are penalized more, which helps to find a better fitting line for the data.",[11,6444,6445,6446,6480,6481,72,6550,6620],{},"Let's now see how we obtain those coefficients ",[383,6447,6449,6462],{"className":6448},[1545],[383,6450,6452],{"className":6451},[1549],[1551,6453,6454],{"xmlns":1553},[1555,6455,6456,6460],{},[1558,6457,6458],{},[1938,6459,2910],{"mathvariant":4076},[1569,6461,4079],{"encoding":1571},[383,6463,6465],{"className":6464,"ariaHidden":1577},[1576],[383,6466,6468,6471],{"className":6467},[1581],[383,6469],{"className":6470,"style":2534},[1585],[383,6472,6474],{"className":6473},[1590],[383,6475,6477],{"className":6476},[1590],[383,6478,2910],{"className":6479,"style":4099},[1590,4098]," using the least squares method. To find the values of ",[383,6482,6484,6501],{"className":6483},[1545],[383,6485,6487],{"className":6486},[1549],[1551,6488,6489],{"xmlns":1553},[1555,6490,6491,6499],{},[1558,6492,6493],{},[1935,6494,6495,6497],{},[1938,6496,2910],{},[1561,6498,2913],{},[1569,6500,3625],{"encoding":1571},[383,6502,6504],{"className":6503,"ariaHidden":1577},[1576],[383,6505,6507,6510],{"className":6506},[1581],[383,6508],{"className":6509,"style":2534},[1585],[383,6511,6513,6516],{"className":6512},[1590],[383,6514,2910],{"className":6515,"style":3006},[1590,2033],[383,6517,6519],{"className":6518},[2037],[383,6520,6522,6542],{"className":6521},[2041,2042],[383,6523,6525,6539],{"className":6524},[2046],[383,6526,6528],{"className":6527,"style":2051},[2050],[383,6529,6530,6533],{"style":3021},[383,6531],{"className":6532,"style":2059},[2058],[383,6534,6536],{"className":6535},[2063,2064,2065,2066],[383,6537,2913],{"className":6538},[1590,2066],[383,6540,2074],{"className":6541},[2073],[383,6543,6545],{"className":6544},[2046],[383,6546,6548],{"className":6547,"style":2081},[2050],[383,6549],{},[383,6551,6553,6571],{"className":6552},[1545],[383,6554,6556],{"className":6555},[1549],[1551,6557,6558],{"xmlns":1553},[1555,6559,6560,6568],{},[1558,6561,6562],{},[1935,6563,6564,6566],{},[1938,6565,2910],{},[1561,6567,1943],{},[1569,6569,6570],{"encoding":1571},"\\beta_1",[383,6572,6574],{"className":6573,"ariaHidden":1577},[1576],[383,6575,6577,6580],{"className":6576},[1581],[383,6578],{"className":6579,"style":2534},[1585],[383,6581,6583,6586],{"className":6582},[1590],[383,6584,2910],{"className":6585,"style":3006},[1590,2033],[383,6587,6589],{"className":6588},[2037],[383,6590,6592,6612],{"className":6591},[2041,2042],[383,6593,6595,6609],{"className":6594},[2046],[383,6596,6598],{"className":6597,"style":2051},[2050],[383,6599,6600,6603],{"style":3021},[383,6601],{"className":6602,"style":2059},[2058],[383,6604,6606],{"className":6605},[2063,2064,2065,2066],[383,6607,1943],{"className":6608},[1590,2066],[383,6610,2074],{"className":6611},[2073],[383,6613,6615],{"className":6614},[2046],[383,6616,6618],{"className":6617,"style":2081},[2050],[383,6619],{},", we can use the following formulas, which are obtained by taking the derivative of the MSE loss function with respect to the coefficients and setting the derivatives equal to zero:",[383,6622,6624],{"className":6623},[2494],[383,6625,6627,6726],{"className":6626},[1545],[383,6628,6630],{"className":6629},[1549],[1551,6631,6632],{"xmlns":1553,"display":2503},[1555,6633,6634,6723],{},[1558,6635,6636,6642,6644],{},[1935,6637,6638,6640],{},[1938,6639,2910],{},[1561,6641,1943],{},[1565,6643,1567],{},[5025,6645,6646,6686],{},[1558,6647,6648,6650,6652,6654,6660,6666,6668,6670,6672,6678,6680],{},[1938,6649,1995],{},[1565,6651,5036],{},[1565,6653,1933],{"stretchy":1929},[1935,6655,6656,6658],{},[1938,6657,1940],{},[1938,6659,2363],{},[1935,6661,6662,6664],{},[1938,6663,1950],{},[1938,6665,2363],{},[1565,6667,1955],{"stretchy":1929},[1565,6669,1680],{},[1565,6671,5036],{},[1935,6673,6674,6676],{},[1938,6675,1940],{},[1938,6677,2363],{},[1565,6679,5036],{},[1935,6681,6682,6684],{},[1938,6683,1950],{},[1938,6685,2363],{},[1558,6687,6688,6690,6692,6694,6703,6705,6707,6709,6711,6717],{},[1938,6689,1995],{},[1565,6691,5036],{},[1565,6693,1933],{"stretchy":1929},[6695,6696,6697,6699,6701],"msubsup",{},[1938,6698,1940],{},[1938,6700,2363],{},[1561,6702,1563],{},[1565,6704,1955],{"stretchy":1929},[1565,6706,1680],{},[1565,6708,1933],{"stretchy":1929},[1565,6710,5036],{},[1935,6712,6713,6715],{},[1938,6714,1940],{},[1938,6716,2363],{},[5068,6718,6719,6721],{},[1565,6720,1955],{"stretchy":1929},[1561,6722,1563],{},[1569,6724,6725],{"encoding":1571},"\\beta_1 = \\frac{n \\sum (x_i y_i) - \\sum x_i \\sum y_i}{n \\sum (x_i^2) - (\\sum x_i)^2}",[383,6727,6729,6784],{"className":6728,"ariaHidden":1577},[1576],[383,6730,6732,6735,6775,6778,6781],{"className":6731},[1581],[383,6733],{"className":6734,"style":2534},[1585],[383,6736,6738,6741],{"className":6737},[1590],[383,6739,2910],{"className":6740,"style":3006},[1590,2033],[383,6742,6744],{"className":6743},[2037],[383,6745,6747,6767],{"className":6746},[2041,2042],[383,6748,6750,6764],{"className":6749},[2046],[383,6751,6753],{"className":6752,"style":2051},[2050],[383,6754,6755,6758],{"style":3021},[383,6756],{"className":6757,"style":2059},[2058],[383,6759,6761],{"className":6760},[2063,2064,2065,2066],[383,6762,1943],{"className":6763},[1590,2066],[383,6765,2074],{"className":6766},[2073],[383,6768,6770],{"className":6769},[2046],[383,6771,6773],{"className":6772,"style":2081},[2050],[383,6774],{},[383,6776],{"className":6777,"style":1595},[1594],[383,6779,1567],{"className":6780},[1599],[383,6782],{"className":6783,"style":1595},[1594],[383,6785,6787,6791],{"className":6786},[1581],[383,6788],{"className":6789,"style":6790},[1585],"height:2.3899em;vertical-align:-0.9629em;",[383,6792,6794,6797,7206],{"className":6793},[1590],[383,6795],{"className":6796},[2025,5119],[383,6798,6800],{"className":6799},[5025],[383,6801,6803,7197],{"className":6802},[2041,2042],[383,6804,6806,7194],{"className":6805},[2046],[383,6807,6810,6979,6987],{"className":6808,"style":6809},[2050],"height:1.427em;",[383,6811,6812,6815],{"style":5135},[383,6813],{"className":6814,"style":4587},[2058],[383,6816,6818,6821,6824,6829,6832,6887,6890,6893,6896,6899,6902,6905,6908,6948],{"className":6817},[1590],[383,6819,1995],{"className":6820},[1590,2033],[383,6822],{"className":6823,"style":1704},[1594],[383,6825,5036],{"className":6826,"style":6828},[5189,5234,6827],"small-op","position:relative;top:0em;",[383,6830,1933],{"className":6831},[2025],[383,6833,6835,6838],{"className":6834},[1590],[383,6836,1940],{"className":6837},[1590,2033],[383,6839,6841],{"className":6840},[2037],[383,6842,6844,6878],{"className":6843},[2041,2042],[383,6845,6847,6875],{"className":6846},[2046],[383,6848,6851,6863],{"className":6849,"style":6850},[2050],"height:0.7959em;",[383,6852,6854,6857],{"style":6853},"top:-2.4231em;margin-left:0em;margin-right:0.05em;",[383,6855],{"className":6856,"style":2059},[2058],[383,6858,6860],{"className":6859},[2063,2064,2065,2066],[383,6861,2363],{"className":6862},[1590,2033,2066],[383,6864,6866,6869],{"style":6865},"top:-3.0448em;margin-right:0.05em;",[383,6867],{"className":6868,"style":2059},[2058],[383,6870,6872],{"className":6871},[2063,2064,2065,2066],[383,6873,1563],{"className":6874},[1590,2066],[383,6876,2074],{"className":6877},[2073],[383,6879,6881],{"className":6880},[2046],[383,6882,6885],{"className":6883,"style":6884},[2050],"height:0.2769em;",[383,6886],{},[383,6888,1955],{"className":6889},[2135],[383,6891],{"className":6892,"style":2577},[1594],[383,6894,1680],{"className":6895},[3048],[383,6897],{"className":6898,"style":2577},[1594],[383,6900,1933],{"className":6901},[2025],[383,6903,5036],{"className":6904,"style":6828},[5189,5234,6827],[383,6906],{"className":6907,"style":1704},[1594],[383,6909,6911,6914],{"className":6910},[1590],[383,6912,1940],{"className":6913},[1590,2033],[383,6915,6917],{"className":6916},[2037],[383,6918,6920,6940],{"className":6919},[2041,2042],[383,6921,6923,6937],{"className":6922},[2046],[383,6924,6926],{"className":6925,"style":2395},[2050],[383,6927,6928,6931],{"style":2054},[383,6929],{"className":6930,"style":2059},[2058],[383,6932,6934],{"className":6933},[2063,2064,2065,2066],[383,6935,2363],{"className":6936},[1590,2033,2066],[383,6938,2074],{"className":6939},[2073],[383,6941,6943],{"className":6942},[2046],[383,6944,6946],{"className":6945,"style":2081},[2050],[383,6947],{},[383,6949,6951,6954],{"className":6950},[2135],[383,6952,1955],{"className":6953},[2135],[383,6955,6957],{"className":6956},[2037],[383,6958,6960],{"className":6959},[2041],[383,6961,6963],{"className":6962},[2046],[383,6964,6967],{"className":6965,"style":6966},[2050],"height:0.7401em;",[383,6968,6970,6973],{"style":6969},"top:-2.989em;margin-right:0.05em;",[383,6971],{"className":6972,"style":2059},[2058],[383,6974,6976],{"className":6975},[2063,2064,2065,2066],[383,6977,1563],{"className":6978},[1590,2066],[383,6980,6981,6984],{"style":5147},[383,6982],{"className":6983,"style":4587},[2058],[383,6985],{"className":6986,"style":5155},[5154],[383,6988,6989,6992],{"style":5158},[383,6990],{"className":6991,"style":4587},[2058],[383,6993,6995,6998,7001,7004,7007,7047,7087,7090,7093,7096,7099,7102,7105,7145,7148,7151,7154],{"className":6994},[1590],[383,6996,1995],{"className":6997},[1590,2033],[383,6999],{"className":7000,"style":1704},[1594],[383,7002,5036],{"className":7003,"style":6828},[5189,5234,6827],[383,7005,1933],{"className":7006},[2025],[383,7008,7010,7013],{"className":7009},[1590],[383,7011,1940],{"className":7012},[1590,2033],[383,7014,7016],{"className":7015},[2037],[383,7017,7019,7039],{"className":7018},[2041,2042],[383,7020,7022,7036],{"className":7021},[2046],[383,7023,7025],{"className":7024,"style":2395},[2050],[383,7026,7027,7030],{"style":2054},[383,7028],{"className":7029,"style":2059},[2058],[383,7031,7033],{"className":7032},[2063,2064,2065,2066],[383,7034,2363],{"className":7035},[1590,2033,2066],[383,7037,2074],{"className":7038},[2073],[383,7040,7042],{"className":7041},[2046],[383,7043,7045],{"className":7044,"style":2081},[2050],[383,7046],{},[383,7048,7050,7053],{"className":7049},[1590],[383,7051,1950],{"className":7052,"style":2096},[1590,2033],[383,7054,7056],{"className":7055},[2037],[383,7057,7059,7079],{"className":7058},[2041,2042],[383,7060,7062,7076],{"className":7061},[2046],[383,7063,7065],{"className":7064,"style":2395},[2050],[383,7066,7067,7070],{"style":2111},[383,7068],{"className":7069,"style":2059},[2058],[383,7071,7073],{"className":7072},[2063,2064,2065,2066],[383,7074,2363],{"className":7075},[1590,2033,2066],[383,7077,2074],{"className":7078},[2073],[383,7080,7082],{"className":7081},[2046],[383,7083,7085],{"className":7084,"style":2081},[2050],[383,7086],{},[383,7088,1955],{"className":7089},[2135],[383,7091],{"className":7092,"style":2577},[1594],[383,7094,1680],{"className":7095},[3048],[383,7097],{"className":7098,"style":2577},[1594],[383,7100,5036],{"className":7101,"style":6828},[5189,5234,6827],[383,7103],{"className":7104,"style":1704},[1594],[383,7106,7108,7111],{"className":7107},[1590],[383,7109,1940],{"className":7110},[1590,2033],[383,7112,7114],{"className":7113},[2037],[383,7115,7117,7137],{"className":7116},[2041,2042],[383,7118,7120,7134],{"className":7119},[2046],[383,7121,7123],{"className":7122,"style":2395},[2050],[383,7124,7125,7128],{"style":2054},[383,7126],{"className":7127,"style":2059},[2058],[383,7129,7131],{"className":7130},[2063,2064,2065,2066],[383,7132,2363],{"className":7133},[1590,2033,2066],[383,7135,2074],{"className":7136},[2073],[383,7138,7140],{"className":7139},[2046],[383,7141,7143],{"className":7142,"style":2081},[2050],[383,7144],{},[383,7146],{"className":7147,"style":1704},[1594],[383,7149,5036],{"className":7150,"style":6828},[5189,5234,6827],[383,7152],{"className":7153,"style":1704},[1594],[383,7155,7157,7160],{"className":7156},[1590],[383,7158,1950],{"className":7159,"style":2096},[1590,2033],[383,7161,7163],{"className":7162},[2037],[383,7164,7166,7186],{"className":7165},[2041,2042],[383,7167,7169,7183],{"className":7168},[2046],[383,7170,7172],{"className":7171,"style":2395},[2050],[383,7173,7174,7177],{"style":2111},[383,7175],{"className":7176,"style":2059},[2058],[383,7178,7180],{"className":7179},[2063,2064,2065,2066],[383,7181,2363],{"className":7182},[1590,2033,2066],[383,7184,2074],{"className":7185},[2073],[383,7187,7189],{"className":7188},[2046],[383,7190,7192],{"className":7191,"style":2081},[2050],[383,7193],{},[383,7195,2074],{"className":7196},[2073],[383,7198,7200],{"className":7199},[2046],[383,7201,7204],{"className":7202,"style":7203},[2050],"height:0.9629em;",[383,7205],{},[383,7207],{"className":7208},[2135,5119],[383,7210,7212],{"className":7211},[2494],[383,7213,7215,7256],{"className":7214},[1545],[383,7216,7218],{"className":7217},[1549],[1551,7219,7220],{"xmlns":1553,"display":2503},[1555,7221,7222,7253],{},[1558,7223,7224,7230,7232,7239,7241,7247],{},[1935,7225,7226,7228],{},[1938,7227,2910],{},[1561,7229,2913],{},[1565,7231,1567],{},[4422,7233,7234,7236],{"accent":1577},[1938,7235,1950],{},[1565,7237,7238],{},"ˉ",[1565,7240,1680],{},[1935,7242,7243,7245],{},[1938,7244,2910],{},[1561,7246,1943],{},[4422,7248,7249,7251],{"accent":1577},[1938,7250,1940],{},[1565,7252,7238],{},[1569,7254,7255],{"encoding":1571},"\\beta_0 = \\bar{y} - \\beta_1 \\bar{x}",[383,7257,7259,7314,7372],{"className":7258,"ariaHidden":1577},[1576],[383,7260,7262,7265,7305,7308,7311],{"className":7261},[1581],[383,7263],{"className":7264,"style":2534},[1585],[383,7266,7268,7271],{"className":7267},[1590],[383,7269,2910],{"className":7270,"style":3006},[1590,2033],[383,7272,7274],{"className":7273},[2037],[383,7275,7277,7297],{"className":7276},[2041,2042],[383,7278,7280,7294],{"className":7279},[2046],[383,7281,7283],{"className":7282,"style":2051},[2050],[383,7284,7285,7288],{"style":3021},[383,7286],{"className":7287,"style":2059},[2058],[383,7289,7291],{"className":7290},[2063,2064,2065,2066],[383,7292,2913],{"className":7293},[1590,2066],[383,7295,2074],{"className":7296},[2073],[383,7298,7300],{"className":7299},[2046],[383,7301,7303],{"className":7302,"style":2081},[2050],[383,7304],{},[383,7306],{"className":7307,"style":1595},[1594],[383,7309,1567],{"className":7310},[1599],[383,7312],{"className":7313,"style":1595},[1594],[383,7315,7317,7320,7363,7366,7369],{"className":7316},[1581],[383,7318],{"className":7319,"style":4508},[1585],[383,7321,7323],{"className":7322},[1590,4570],[383,7324,7326,7355],{"className":7325},[2041,2042],[383,7327,7329,7352],{"className":7328},[2046],[383,7330,7333,7341],{"className":7331,"style":7332},[2050],"height:0.5678em;",[383,7334,7335,7338],{"style":4583},[383,7336],{"className":7337,"style":4587},[2058],[383,7339,1950],{"className":7340,"style":2096},[1590,2033],[383,7342,7343,7346],{"style":4583},[383,7344],{"className":7345,"style":4587},[2058],[383,7347,7349],{"className":7348,"style":5636},[4637],[383,7350,7238],{"className":7351},[1590],[383,7353,2074],{"className":7354},[2073],[383,7356,7358],{"className":7357},[2046],[383,7359,7361],{"className":7360,"style":4651},[2050],[383,7362],{},[383,7364],{"className":7365,"style":2577},[1594],[383,7367,1680],{"className":7368},[3048],[383,7370],{"className":7371,"style":2577},[1594],[383,7373,7375,7378,7418],{"className":7374},[1581],[383,7376],{"className":7377,"style":2534},[1585],[383,7379,7381,7384],{"className":7380},[1590],[383,7382,2910],{"className":7383,"style":3006},[1590,2033],[383,7385,7387],{"className":7386},[2037],[383,7388,7390,7410],{"className":7389},[2041,2042],[383,7391,7393,7407],{"className":7392},[2046],[383,7394,7396],{"className":7395,"style":2051},[2050],[383,7397,7398,7401],{"style":3021},[383,7399],{"className":7400,"style":2059},[2058],[383,7402,7404],{"className":7403},[2063,2064,2065,2066],[383,7405,1943],{"className":7406},[1590,2066],[383,7408,2074],{"className":7409},[2073],[383,7411,7413],{"className":7412},[2046],[383,7414,7416],{"className":7415,"style":2081},[2050],[383,7417],{},[383,7419,7421],{"className":7420},[1590,4570],[383,7422,7424],{"className":7423},[2041],[383,7425,7427],{"className":7426},[2046],[383,7428,7430,7438],{"className":7429,"style":7332},[2050],[383,7431,7432,7435],{"style":4583},[383,7433],{"className":7434,"style":4587},[2058],[383,7436,1940],{"className":7437},[1590,2033],[383,7439,7440,7443],{"style":4583},[383,7441],{"className":7442,"style":4587},[2058],[383,7444,7447],{"className":7445,"style":7446},[4637],"left:-0.2222em;",[383,7448,7238],{"className":7449},[1590],[11,7451,3370],{},[34,7453,7454,7484,7625],{},[37,7455,7456,5467],{},[383,7457,7459,7472],{"className":7458},[1545],[383,7460,7462],{"className":7461},[1549],[1551,7463,7464],{"xmlns":1553},[1555,7465,7466,7470],{},[1558,7467,7468],{},[1938,7469,1995],{},[1569,7471,1995],{"encoding":1571},[383,7473,7475],{"className":7474,"ariaHidden":1577},[1576],[383,7476,7478,7481],{"className":7477},[1581],[383,7479],{"className":7480,"style":3364},[1585],[383,7482,1995],{"className":7483},[1590,2033],[37,7485,7486,72,7555,7624],{},[383,7487,7489,7506],{"className":7488},[1545],[383,7490,7492],{"className":7491},[1549],[1551,7493,7494],{"xmlns":1553},[1555,7495,7496,7504],{},[1558,7497,7498],{},[1935,7499,7500,7502],{},[1938,7501,1940],{},[1938,7503,2363],{},[1569,7505,2366],{"encoding":1571},[383,7507,7509],{"className":7508,"ariaHidden":1577},[1576],[383,7510,7512,7515],{"className":7511},[1581],[383,7513],{"className":7514,"style":2376},[1585],[383,7516,7518,7521],{"className":7517},[1590],[383,7519,1940],{"className":7520},[1590,2033],[383,7522,7524],{"className":7523},[2037],[383,7525,7527,7547],{"className":7526},[2041,2042],[383,7528,7530,7544],{"className":7529},[2046],[383,7531,7533],{"className":7532,"style":2395},[2050],[383,7534,7535,7538],{"style":2054},[383,7536],{"className":7537,"style":2059},[2058],[383,7539,7541],{"className":7540},[2063,2064,2065,2066],[383,7542,2363],{"className":7543},[1590,2033,2066],[383,7545,2074],{"className":7546},[2073],[383,7548,7550],{"className":7549},[2046],[383,7551,7553],{"className":7552,"style":2081},[2050],[383,7554],{},[383,7556,7558,7575],{"className":7557},[1545],[383,7559,7561],{"className":7560},[1549],[1551,7562,7563],{"xmlns":1553},[1555,7564,7565,7573],{},[1558,7566,7567],{},[1935,7568,7569,7571],{},[1938,7570,1950],{},[1938,7572,2363],{},[1569,7574,2439],{"encoding":1571},[383,7576,7578],{"className":7577,"ariaHidden":1577},[1576],[383,7579,7581,7584],{"className":7580},[1581],[383,7582],{"className":7583,"style":2449},[1585],[383,7585,7587,7590],{"className":7586},[1590],[383,7588,1950],{"className":7589,"style":2096},[1590,2033],[383,7591,7593],{"className":7592},[2037],[383,7594,7596,7616],{"className":7595},[2041,2042],[383,7597,7599,7613],{"className":7598},[2046],[383,7600,7602],{"className":7601,"style":2395},[2050],[383,7603,7604,7607],{"style":2111},[383,7605],{"className":7606,"style":2059},[2058],[383,7608,7610],{"className":7609},[2063,2064,2065,2066],[383,7611,2363],{"className":7612},[1590,2033,2066],[383,7614,2074],{"className":7615},[2073],[383,7617,7619],{"className":7618},[2046],[383,7620,7622],{"className":7621,"style":2081},[2050],[383,7623],{}," are the values of the independent and dependent variables for each example.",[37,7626,7627,72,7688,7761],{},[383,7628,7630,7648],{"className":7629},[1545],[383,7631,7633],{"className":7632},[1549],[1551,7634,7635],{"xmlns":1553},[1555,7636,7637,7645],{},[1558,7638,7639],{},[4422,7640,7641,7643],{"accent":1577},[1938,7642,1940],{},[1565,7644,7238],{},[1569,7646,7647],{"encoding":1571},"\\bar{x}",[383,7649,7651],{"className":7650,"ariaHidden":1577},[1576],[383,7652,7654,7657],{"className":7653},[1581],[383,7655],{"className":7656,"style":7332},[1585],[383,7658,7660],{"className":7659},[1590,4570],[383,7661,7663],{"className":7662},[2041],[383,7664,7666],{"className":7665},[2046],[383,7667,7669,7677],{"className":7668,"style":7332},[2050],[383,7670,7671,7674],{"style":4583},[383,7672],{"className":7673,"style":4587},[2058],[383,7675,1940],{"className":7676},[1590,2033],[383,7678,7679,7682],{"style":4583},[383,7680],{"className":7681,"style":4587},[2058],[383,7683,7685],{"className":7684,"style":7446},[4637],[383,7686,7238],{"className":7687},[1590],[383,7689,7691,7709],{"className":7690},[1545],[383,7692,7694],{"className":7693},[1549],[1551,7695,7696],{"xmlns":1553},[1555,7697,7698,7706],{},[1558,7699,7700],{},[4422,7701,7702,7704],{"accent":1577},[1938,7703,1950],{},[1565,7705,7238],{},[1569,7707,7708],{"encoding":1571},"\\bar{y}",[383,7710,7712],{"className":7711,"ariaHidden":1577},[1576],[383,7713,7715,7719],{"className":7714},[1581],[383,7716],{"className":7717,"style":7718},[1585],"height:0.7622em;vertical-align:-0.1944em;",[383,7720,7722],{"className":7721},[1590,4570],[383,7723,7725,7753],{"className":7724},[2041,2042],[383,7726,7728,7750],{"className":7727},[2046],[383,7729,7731,7739],{"className":7730,"style":7332},[2050],[383,7732,7733,7736],{"style":4583},[383,7734],{"className":7735,"style":4587},[2058],[383,7737,1950],{"className":7738,"style":2096},[1590,2033],[383,7740,7741,7744],{"style":4583},[383,7742],{"className":7743,"style":4587},[2058],[383,7745,7747],{"className":7746,"style":5636},[4637],[383,7748,7238],{"className":7749},[1590],[383,7751,2074],{"className":7752},[2073],[383,7754,7756],{"className":7755},[2046],[383,7757,7759],{"className":7758,"style":4651},[2050],[383,7760],{}," are the means (or averages) of the independent and dependent variables, respectively.",[11,7763,7764],{},"Let's do an example to understand how to apply it. Suppose we have a dataset with the following characteristics:",[836,7766,7767,7777],{},[839,7768,7769],{},[842,7770,7771,7774],{},[845,7772,7773],{},"Size (m²)",[845,7775,7776],{},"Price (USD)",[854,7778,7779,7787,7795],{},[842,7780,7781,7784],{},[859,7782,7783],{},"50",[859,7785,7786],{},"100,000",[842,7788,7789,7792],{},[859,7790,7791],{},"100",[859,7793,7794],{},"200,000",[842,7796,7797,7800],{},[859,7798,7799],{},"150",[859,7801,7802],{},"300,000",[11,7804,7805,7806,7809],{},"We want to build a linear regression model to ",[40,7807,7808],{},"predict the price"," of a house based on its size. In this case, the independent variable is the size (X) and the dependent variable is the price (Y). The linear regression model can be expressed as:",[383,7811,7813],{"className":7812},[2494],[383,7814,7816,7852],{"className":7815},[1545],[383,7817,7819],{"className":7818},[1549],[1551,7820,7821],{"xmlns":1553,"display":2503},[1555,7822,7823,7849],{},[1558,7824,7825,7827,7829,7835,7837,7843,7845,7847],{},[1938,7826,1950],{},[1565,7828,1567],{},[1935,7830,7831,7833],{},[1938,7832,2910],{},[1561,7834,2913],{},[1565,7836,2916],{},[1935,7838,7839,7841],{},[1938,7840,2910],{},[1561,7842,1943],{},[1938,7844,1940],{},[1565,7846,2916],{},[1938,7848,2969],{},[1569,7850,7851],{"encoding":1571},"y = \\beta_0 + \\beta_1 x + \\epsilon",[383,7853,7855,7873,7928,7986],{"className":7854,"ariaHidden":1577},[1576],[383,7856,7858,7861,7864,7867,7870],{"className":7857},[1581],[383,7859],{"className":7860,"style":2449},[1585],[383,7862,1950],{"className":7863,"style":2096},[1590,2033],[383,7865],{"className":7866,"style":1595},[1594],[383,7868,1567],{"className":7869},[1599],[383,7871],{"className":7872,"style":1595},[1594],[383,7874,7876,7879,7919,7922,7925],{"className":7875},[1581],[383,7877],{"className":7878,"style":2534},[1585],[383,7880,7882,7885],{"className":7881},[1590],[383,7883,2910],{"className":7884,"style":3006},[1590,2033],[383,7886,7888],{"className":7887},[2037],[383,7889,7891,7911],{"className":7890},[2041,2042],[383,7892,7894,7908],{"className":7893},[2046],[383,7895,7897],{"className":7896,"style":2051},[2050],[383,7898,7899,7902],{"style":3021},[383,7900],{"className":7901,"style":2059},[2058],[383,7903,7905],{"className":7904},[2063,2064,2065,2066],[383,7906,2913],{"className":7907},[1590,2066],[383,7909,2074],{"className":7910},[2073],[383,7912,7914],{"className":7913},[2046],[383,7915,7917],{"className":7916,"style":2081},[2050],[383,7918],{},[383,7920],{"className":7921,"style":2577},[1594],[383,7923,2916],{"className":7924},[3048],[383,7926],{"className":7927,"style":2577},[1594],[383,7929,7931,7934,7974,7977,7980,7983],{"className":7930},[1581],[383,7932],{"className":7933,"style":2534},[1585],[383,7935,7937,7940],{"className":7936},[1590],[383,7938,2910],{"className":7939,"style":3006},[1590,2033],[383,7941,7943],{"className":7942},[2037],[383,7944,7946,7966],{"className":7945},[2041,2042],[383,7947,7949,7963],{"className":7948},[2046],[383,7950,7952],{"className":7951,"style":2051},[2050],[383,7953,7954,7957],{"style":3021},[383,7955],{"className":7956,"style":2059},[2058],[383,7958,7960],{"className":7959},[2063,2064,2065,2066],[383,7961,1943],{"className":7962},[1590,2066],[383,7964,2074],{"className":7965},[2073],[383,7967,7969],{"className":7968},[2046],[383,7970,7972],{"className":7971,"style":2081},[2050],[383,7973],{},[383,7975,1940],{"className":7976},[1590,2033],[383,7978],{"className":7979,"style":2577},[1594],[383,7981,2916],{"className":7982},[3048],[383,7984],{"className":7985,"style":2577},[1594],[383,7987,7989,7992],{"className":7988},[1581],[383,7990],{"className":7991,"style":3364},[1585],[383,7993,2969],{"className":7994},[1590,2033],[11,7996,3370],{},[34,7998,7999,8030,8061,8133,8205],{},[37,8000,8001,8029],{},[383,8002,8004,8017],{"className":8003},[1545],[383,8005,8007],{"className":8006},[1549],[1551,8008,8009],{"xmlns":1553},[1555,8010,8011,8015],{},[1558,8012,8013],{},[1938,8014,1950],{},[1569,8016,1950],{"encoding":1571},[383,8018,8020],{"className":8019,"ariaHidden":1577},[1576],[383,8021,8023,8026],{"className":8022},[1581],[383,8024],{"className":8025,"style":2449},[1585],[383,8027,1950],{"className":8028,"style":2096},[1590,2033]," is the price of the house.",[37,8031,8032,8060],{},[383,8033,8035,8048],{"className":8034},[1545],[383,8036,8038],{"className":8037},[1549],[1551,8039,8040],{"xmlns":1553},[1555,8041,8042,8046],{},[1558,8043,8044],{},[1938,8045,1940],{},[1569,8047,1940],{"encoding":1571},[383,8049,8051],{"className":8050,"ariaHidden":1577},[1576],[383,8052,8054,8057],{"className":8053},[1581],[383,8055],{"className":8056,"style":3364},[1585],[383,8058,1940],{"className":8059},[1590,2033]," is the size of the house.",[37,8062,8063,8132],{},[383,8064,8066,8083],{"className":8065},[1545],[383,8067,8069],{"className":8068},[1549],[1551,8070,8071],{"xmlns":1553},[1555,8072,8073,8081],{},[1558,8074,8075],{},[1935,8076,8077,8079],{},[1938,8078,2910],{},[1561,8080,2913],{},[1569,8082,3625],{"encoding":1571},[383,8084,8086],{"className":8085,"ariaHidden":1577},[1576],[383,8087,8089,8092],{"className":8088},[1581],[383,8090],{"className":8091,"style":2534},[1585],[383,8093,8095,8098],{"className":8094},[1590],[383,8096,2910],{"className":8097,"style":3006},[1590,2033],[383,8099,8101],{"className":8100},[2037],[383,8102,8104,8124],{"className":8103},[2041,2042],[383,8105,8107,8121],{"className":8106},[2046],[383,8108,8110],{"className":8109,"style":2051},[2050],[383,8111,8112,8115],{"style":3021},[383,8113],{"className":8114,"style":2059},[2058],[383,8116,8118],{"className":8117},[2063,2064,2065,2066],[383,8119,2913],{"className":8120},[1590,2066],[383,8122,2074],{"className":8123},[2073],[383,8125,8127],{"className":8126},[2046],[383,8128,8130],{"className":8129,"style":2081},[2050],[383,8131],{}," is the y-intercept.",[37,8134,8135,8204],{},[383,8136,8138,8155],{"className":8137},[1545],[383,8139,8141],{"className":8140},[1549],[1551,8142,8143],{"xmlns":1553},[1555,8144,8145,8153],{},[1558,8146,8147],{},[1935,8148,8149,8151],{},[1938,8150,2910],{},[1561,8152,1943],{},[1569,8154,6570],{"encoding":1571},[383,8156,8158],{"className":8157,"ariaHidden":1577},[1576],[383,8159,8161,8164],{"className":8160},[1581],[383,8162],{"className":8163,"style":2534},[1585],[383,8165,8167,8170],{"className":8166},[1590],[383,8168,2910],{"className":8169,"style":3006},[1590,2033],[383,8171,8173],{"className":8172},[2037],[383,8174,8176,8196],{"className":8175},[2041,2042],[383,8177,8179,8193],{"className":8178},[2046],[383,8180,8182],{"className":8181,"style":2051},[2050],[383,8183,8184,8187],{"style":3021},[383,8185],{"className":8186,"style":2059},[2058],[383,8188,8190],{"className":8189},[2063,2064,2065,2066],[383,8191,1943],{"className":8192},[1590,2066],[383,8194,2074],{"className":8195},[2073],[383,8197,8199],{"className":8198},[2046],[383,8200,8202],{"className":8201,"style":2081},[2050],[383,8203],{}," is the slope.",[37,8206,8207,8235],{},[383,8208,8210,8223],{"className":8209},[1545],[383,8211,8213],{"className":8212},[1549],[1551,8214,8215],{"xmlns":1553},[1555,8216,8217,8221],{},[1558,8218,8219],{},[1938,8220,2969],{},[1569,8222,3950],{"encoding":1571},[383,8224,8226],{"className":8225,"ariaHidden":1577},[1576],[383,8227,8229,8232],{"className":8228},[1581],[383,8230],{"className":8231,"style":3364},[1585],[383,8233,2969],{"className":8234},[1590,2033]," is the error or noise, which for this example we will assume is zero for simplicity.",[11,8237,8238,8239,72,8308,8377],{},"To find the values of ",[383,8240,8242,8259],{"className":8241},[1545],[383,8243,8245],{"className":8244},[1549],[1551,8246,8247],{"xmlns":1553},[1555,8248,8249,8257],{},[1558,8250,8251],{},[1935,8252,8253,8255],{},[1938,8254,2910],{},[1561,8256,2913],{},[1569,8258,3625],{"encoding":1571},[383,8260,8262],{"className":8261,"ariaHidden":1577},[1576],[383,8263,8265,8268],{"className":8264},[1581],[383,8266],{"className":8267,"style":2534},[1585],[383,8269,8271,8274],{"className":8270},[1590],[383,8272,2910],{"className":8273,"style":3006},[1590,2033],[383,8275,8277],{"className":8276},[2037],[383,8278,8280,8300],{"className":8279},[2041,2042],[383,8281,8283,8297],{"className":8282},[2046],[383,8284,8286],{"className":8285,"style":2051},[2050],[383,8287,8288,8291],{"style":3021},[383,8289],{"className":8290,"style":2059},[2058],[383,8292,8294],{"className":8293},[2063,2064,2065,2066],[383,8295,2913],{"className":8296},[1590,2066],[383,8298,2074],{"className":8299},[2073],[383,8301,8303],{"className":8302},[2046],[383,8304,8306],{"className":8305,"style":2081},[2050],[383,8307],{},[383,8309,8311,8328],{"className":8310},[1545],[383,8312,8314],{"className":8313},[1549],[1551,8315,8316],{"xmlns":1553},[1555,8317,8318,8326],{},[1558,8319,8320],{},[1935,8321,8322,8324],{},[1938,8323,2910],{},[1561,8325,1943],{},[1569,8327,6570],{"encoding":1571},[383,8329,8331],{"className":8330,"ariaHidden":1577},[1576],[383,8332,8334,8337],{"className":8333},[1581],[383,8335],{"className":8336,"style":2534},[1585],[383,8338,8340,8343],{"className":8339},[1590],[383,8341,2910],{"className":8342,"style":3006},[1590,2033],[383,8344,8346],{"className":8345},[2037],[383,8347,8349,8369],{"className":8348},[2041,2042],[383,8350,8352,8366],{"className":8351},[2046],[383,8353,8355],{"className":8354,"style":2051},[2050],[383,8356,8357,8360],{"style":3021},[383,8358],{"className":8359,"style":2059},[2058],[383,8361,8363],{"className":8362},[2063,2064,2065,2066],[383,8364,1943],{"className":8365},[1590,2066],[383,8367,2074],{"className":8368},[2073],[383,8370,8372],{"className":8371},[2046],[383,8373,8375],{"className":8374,"style":2081},[2050],[383,8376],{},", we can use the least squares method with the formula we mentioned earlier:",[383,8379,8381],{"className":8380},[2494],[383,8382,8384,8481],{"className":8383},[1545],[383,8385,8387],{"className":8386},[1549],[1551,8388,8389],{"xmlns":1553,"display":2503},[1555,8390,8391,8479],{},[1558,8392,8393,8399,8401],{},[1935,8394,8395,8397],{},[1938,8396,2910],{},[1561,8398,1943],{},[1565,8400,1567],{},[5025,8402,8403,8443],{},[1558,8404,8405,8407,8409,8411,8417,8423,8425,8427,8429,8435,8437],{},[1938,8406,1995],{},[1565,8408,5036],{},[1565,8410,1933],{"stretchy":1929},[1935,8412,8413,8415],{},[1938,8414,1940],{},[1938,8416,2363],{},[1935,8418,8419,8421],{},[1938,8420,1950],{},[1938,8422,2363],{},[1565,8424,1955],{"stretchy":1929},[1565,8426,1680],{},[1565,8428,5036],{},[1935,8430,8431,8433],{},[1938,8432,1940],{},[1938,8434,2363],{},[1565,8436,5036],{},[1935,8438,8439,8441],{},[1938,8440,1950],{},[1938,8442,2363],{},[1558,8444,8445,8447,8449,8451,8459,8461,8463,8465,8467,8473],{},[1938,8446,1995],{},[1565,8448,5036],{},[1565,8450,1933],{"stretchy":1929},[6695,8452,8453,8455,8457],{},[1938,8454,1940],{},[1938,8456,2363],{},[1561,8458,1563],{},[1565,8460,1955],{"stretchy":1929},[1565,8462,1680],{},[1565,8464,1933],{"stretchy":1929},[1565,8466,5036],{},[1935,8468,8469,8471],{},[1938,8470,1940],{},[1938,8472,2363],{},[5068,8474,8475,8477],{},[1565,8476,1955],{"stretchy":1929},[1561,8478,1563],{},[1569,8480,6725],{"encoding":1571},[383,8482,8484,8539],{"className":8483,"ariaHidden":1577},[1576],[383,8485,8487,8490,8530,8533,8536],{"className":8486},[1581],[383,8488],{"className":8489,"style":2534},[1585],[383,8491,8493,8496],{"className":8492},[1590],[383,8494,2910],{"className":8495,"style":3006},[1590,2033],[383,8497,8499],{"className":8498},[2037],[383,8500,8502,8522],{"className":8501},[2041,2042],[383,8503,8505,8519],{"className":8504},[2046],[383,8506,8508],{"className":8507,"style":2051},[2050],[383,8509,8510,8513],{"style":3021},[383,8511],{"className":8512,"style":2059},[2058],[383,8514,8516],{"className":8515},[2063,2064,2065,2066],[383,8517,1943],{"className":8518},[1590,2066],[383,8520,2074],{"className":8521},[2073],[383,8523,8525],{"className":8524},[2046],[383,8526,8528],{"className":8527,"style":2081},[2050],[383,8529],{},[383,8531],{"className":8532,"style":1595},[1594],[383,8534,1567],{"className":8535},[1599],[383,8537],{"className":8538,"style":1595},[1594],[383,8540,8542,8545],{"className":8541},[1581],[383,8543],{"className":8544,"style":6790},[1585],[383,8546,8548,8551,8950],{"className":8547},[1590],[383,8549],{"className":8550},[2025,5119],[383,8552,8554],{"className":8553},[5025],[383,8555,8557,8942],{"className":8556},[2041,2042],[383,8558,8560,8939],{"className":8559},[2046],[383,8561,8563,8724,8732],{"className":8562,"style":6809},[2050],[383,8564,8565,8568],{"style":5135},[383,8566],{"className":8567,"style":4587},[2058],[383,8569,8571,8574,8577,8580,8583,8634,8637,8640,8643,8646,8649,8652,8655,8695],{"className":8570},[1590],[383,8572,1995],{"className":8573},[1590,2033],[383,8575],{"className":8576,"style":1704},[1594],[383,8578,5036],{"className":8579,"style":6828},[5189,5234,6827],[383,8581,1933],{"className":8582},[2025],[383,8584,8586,8589],{"className":8585},[1590],[383,8587,1940],{"className":8588},[1590,2033],[383,8590,8592],{"className":8591},[2037],[383,8593,8595,8626],{"className":8594},[2041,2042],[383,8596,8598,8623],{"className":8597},[2046],[383,8599,8601,8612],{"className":8600,"style":6850},[2050],[383,8602,8603,8606],{"style":6853},[383,8604],{"className":8605,"style":2059},[2058],[383,8607,8609],{"className":8608},[2063,2064,2065,2066],[383,8610,2363],{"className":8611},[1590,2033,2066],[383,8613,8614,8617],{"style":6865},[383,8615],{"className":8616,"style":2059},[2058],[383,8618,8620],{"className":8619},[2063,2064,2065,2066],[383,8621,1563],{"className":8622},[1590,2066],[383,8624,2074],{"className":8625},[2073],[383,8627,8629],{"className":8628},[2046],[383,8630,8632],{"className":8631,"style":6884},[2050],[383,8633],{},[383,8635,1955],{"className":8636},[2135],[383,8638],{"className":8639,"style":2577},[1594],[383,8641,1680],{"className":8642},[3048],[383,8644],{"className":8645,"style":2577},[1594],[383,8647,1933],{"className":8648},[2025],[383,8650,5036],{"className":8651,"style":6828},[5189,5234,6827],[383,8653],{"className":8654,"style":1704},[1594],[383,8656,8658,8661],{"className":8657},[1590],[383,8659,1940],{"className":8660},[1590,2033],[383,8662,8664],{"className":8663},[2037],[383,8665,8667,8687],{"className":8666},[2041,2042],[383,8668,8670,8684],{"className":8669},[2046],[383,8671,8673],{"className":8672,"style":2395},[2050],[383,8674,8675,8678],{"style":2054},[383,8676],{"className":8677,"style":2059},[2058],[383,8679,8681],{"className":8680},[2063,2064,2065,2066],[383,8682,2363],{"className":8683},[1590,2033,2066],[383,8685,2074],{"className":8686},[2073],[383,8688,8690],{"className":8689},[2046],[383,8691,8693],{"className":8692,"style":2081},[2050],[383,8694],{},[383,8696,8698,8701],{"className":8697},[2135],[383,8699,1955],{"className":8700},[2135],[383,8702,8704],{"className":8703},[2037],[383,8705,8707],{"className":8706},[2041],[383,8708,8710],{"className":8709},[2046],[383,8711,8713],{"className":8712,"style":6966},[2050],[383,8714,8715,8718],{"style":6969},[383,8716],{"className":8717,"style":2059},[2058],[383,8719,8721],{"className":8720},[2063,2064,2065,2066],[383,8722,1563],{"className":8723},[1590,2066],[383,8725,8726,8729],{"style":5147},[383,8727],{"className":8728,"style":4587},[2058],[383,8730],{"className":8731,"style":5155},[5154],[383,8733,8734,8737],{"style":5158},[383,8735],{"className":8736,"style":4587},[2058],[383,8738,8740,8743,8746,8749,8752,8792,8832,8835,8838,8841,8844,8847,8850,8890,8893,8896,8899],{"className":8739},[1590],[383,8741,1995],{"className":8742},[1590,2033],[383,8744],{"className":8745,"style":1704},[1594],[383,8747,5036],{"className":8748,"style":6828},[5189,5234,6827],[383,8750,1933],{"className":8751},[2025],[383,8753,8755,8758],{"className":8754},[1590],[383,8756,1940],{"className":8757},[1590,2033],[383,8759,8761],{"className":8760},[2037],[383,8762,8764,8784],{"className":8763},[2041,2042],[383,8765,8767,8781],{"className":8766},[2046],[383,8768,8770],{"className":8769,"style":2395},[2050],[383,8771,8772,8775],{"style":2054},[383,8773],{"className":8774,"style":2059},[2058],[383,8776,8778],{"className":8777},[2063,2064,2065,2066],[383,8779,2363],{"className":8780},[1590,2033,2066],[383,8782,2074],{"className":8783},[2073],[383,8785,8787],{"className":8786},[2046],[383,8788,8790],{"className":8789,"style":2081},[2050],[383,8791],{},[383,8793,8795,8798],{"className":8794},[1590],[383,8796,1950],{"className":8797,"style":2096},[1590,2033],[383,8799,8801],{"className":8800},[2037],[383,8802,8804,8824],{"className":8803},[2041,2042],[383,8805,8807,8821],{"className":8806},[2046],[383,8808,8810],{"className":8809,"style":2395},[2050],[383,8811,8812,8815],{"style":2111},[383,8813],{"className":8814,"style":2059},[2058],[383,8816,8818],{"className":8817},[2063,2064,2065,2066],[383,8819,2363],{"className":8820},[1590,2033,2066],[383,8822,2074],{"className":8823},[2073],[383,8825,8827],{"className":8826},[2046],[383,8828,8830],{"className":8829,"style":2081},[2050],[383,8831],{},[383,8833,1955],{"className":8834},[2135],[383,8836],{"className":8837,"style":2577},[1594],[383,8839,1680],{"className":8840},[3048],[383,8842],{"className":8843,"style":2577},[1594],[383,8845,5036],{"className":8846,"style":6828},[5189,5234,6827],[383,8848],{"className":8849,"style":1704},[1594],[383,8851,8853,8856],{"className":8852},[1590],[383,8854,1940],{"className":8855},[1590,2033],[383,8857,8859],{"className":8858},[2037],[383,8860,8862,8882],{"className":8861},[2041,2042],[383,8863,8865,8879],{"className":8864},[2046],[383,8866,8868],{"className":8867,"style":2395},[2050],[383,8869,8870,8873],{"style":2054},[383,8871],{"className":8872,"style":2059},[2058],[383,8874,8876],{"className":8875},[2063,2064,2065,2066],[383,8877,2363],{"className":8878},[1590,2033,2066],[383,8880,2074],{"className":8881},[2073],[383,8883,8885],{"className":8884},[2046],[383,8886,8888],{"className":8887,"style":2081},[2050],[383,8889],{},[383,8891],{"className":8892,"style":1704},[1594],[383,8894,5036],{"className":8895,"style":6828},[5189,5234,6827],[383,8897],{"className":8898,"style":1704},[1594],[383,8900,8902,8905],{"className":8901},[1590],[383,8903,1950],{"className":8904,"style":2096},[1590,2033],[383,8906,8908],{"className":8907},[2037],[383,8909,8911,8931],{"className":8910},[2041,2042],[383,8912,8914,8928],{"className":8913},[2046],[383,8915,8917],{"className":8916,"style":2395},[2050],[383,8918,8919,8922],{"style":2111},[383,8920],{"className":8921,"style":2059},[2058],[383,8923,8925],{"className":8924},[2063,2064,2065,2066],[383,8926,2363],{"className":8927},[1590,2033,2066],[383,8929,2074],{"className":8930},[2073],[383,8932,8934],{"className":8933},[2046],[383,8935,8937],{"className":8936,"style":2081},[2050],[383,8938],{},[383,8940,2074],{"className":8941},[2073],[383,8943,8945],{"className":8944},[2046],[383,8946,8948],{"className":8947,"style":7203},[2050],[383,8949],{},[383,8951],{"className":8952},[2135,5119],[383,8954,8956],{"className":8955},[2494],[383,8957,8959,8998],{"className":8958},[1545],[383,8960,8962],{"className":8961},[1549],[1551,8963,8964],{"xmlns":1553,"display":2503},[1555,8965,8966,8996],{},[1558,8967,8968,8974,8976,8982,8984,8990],{},[1935,8969,8970,8972],{},[1938,8971,2910],{},[1561,8973,2913],{},[1565,8975,1567],{},[4422,8977,8978,8980],{"accent":1577},[1938,8979,1950],{},[1565,8981,7238],{},[1565,8983,1680],{},[1935,8985,8986,8988],{},[1938,8987,2910],{},[1561,8989,1943],{},[4422,8991,8992,8994],{"accent":1577},[1938,8993,1940],{},[1565,8995,7238],{},[1569,8997,7255],{"encoding":1571},[383,8999,9001,9056,9113],{"className":9000,"ariaHidden":1577},[1576],[383,9002,9004,9007,9047,9050,9053],{"className":9003},[1581],[383,9005],{"className":9006,"style":2534},[1585],[383,9008,9010,9013],{"className":9009},[1590],[383,9011,2910],{"className":9012,"style":3006},[1590,2033],[383,9014,9016],{"className":9015},[2037],[383,9017,9019,9039],{"className":9018},[2041,2042],[383,9020,9022,9036],{"className":9021},[2046],[383,9023,9025],{"className":9024,"style":2051},[2050],[383,9026,9027,9030],{"style":3021},[383,9028],{"className":9029,"style":2059},[2058],[383,9031,9033],{"className":9032},[2063,2064,2065,2066],[383,9034,2913],{"className":9035},[1590,2066],[383,9037,2074],{"className":9038},[2073],[383,9040,9042],{"className":9041},[2046],[383,9043,9045],{"className":9044,"style":2081},[2050],[383,9046],{},[383,9048],{"className":9049,"style":1595},[1594],[383,9051,1567],{"className":9052},[1599],[383,9054],{"className":9055,"style":1595},[1594],[383,9057,9059,9062,9104,9107,9110],{"className":9058},[1581],[383,9060],{"className":9061,"style":4508},[1585],[383,9063,9065],{"className":9064},[1590,4570],[383,9066,9068,9096],{"className":9067},[2041,2042],[383,9069,9071,9093],{"className":9070},[2046],[383,9072,9074,9082],{"className":9073,"style":7332},[2050],[383,9075,9076,9079],{"style":4583},[383,9077],{"className":9078,"style":4587},[2058],[383,9080,1950],{"className":9081,"style":2096},[1590,2033],[383,9083,9084,9087],{"style":4583},[383,9085],{"className":9086,"style":4587},[2058],[383,9088,9090],{"className":9089,"style":5636},[4637],[383,9091,7238],{"className":9092},[1590],[383,9094,2074],{"className":9095},[2073],[383,9097,9099],{"className":9098},[2046],[383,9100,9102],{"className":9101,"style":4651},[2050],[383,9103],{},[383,9105],{"className":9106,"style":2577},[1594],[383,9108,1680],{"className":9109},[3048],[383,9111],{"className":9112,"style":2577},[1594],[383,9114,9116,9119,9159],{"className":9115},[1581],[383,9117],{"className":9118,"style":2534},[1585],[383,9120,9122,9125],{"className":9121},[1590],[383,9123,2910],{"className":9124,"style":3006},[1590,2033],[383,9126,9128],{"className":9127},[2037],[383,9129,9131,9151],{"className":9130},[2041,2042],[383,9132,9134,9148],{"className":9133},[2046],[383,9135,9137],{"className":9136,"style":2051},[2050],[383,9138,9139,9142],{"style":3021},[383,9140],{"className":9141,"style":2059},[2058],[383,9143,9145],{"className":9144},[2063,2064,2065,2066],[383,9146,1943],{"className":9147},[1590,2066],[383,9149,2074],{"className":9150},[2073],[383,9152,9154],{"className":9153},[2046],[383,9155,9157],{"className":9156,"style":2081},[2050],[383,9158],{},[383,9160,9162],{"className":9161},[1590,4570],[383,9163,9165],{"className":9164},[2041],[383,9166,9168],{"className":9167},[2046],[383,9169,9171,9179],{"className":9170,"style":7332},[2050],[383,9172,9173,9176],{"style":4583},[383,9174],{"className":9175,"style":4587},[2058],[383,9177,1940],{"className":9178},[1590,2033],[383,9180,9181,9184],{"style":4583},[383,9182],{"className":9183,"style":4587},[2058],[383,9185,9187],{"className":9186,"style":7446},[4637],[383,9188,7238],{"className":9189},[1590],[11,9191,3370],{},[34,9193,9194,9225,9366],{},[37,9195,9196,9224],{},[383,9197,9199,9212],{"className":9198},[1545],[383,9200,9202],{"className":9201},[1549],[1551,9203,9204],{"xmlns":1553},[1555,9205,9206,9210],{},[1558,9207,9208],{},[1938,9209,1995],{},[1569,9211,1995],{"encoding":1571},[383,9213,9215],{"className":9214,"ariaHidden":1577},[1576],[383,9216,9218,9221],{"className":9217},[1581],[383,9219],{"className":9220,"style":3364},[1585],[383,9222,1995],{"className":9223},[1590,2033]," is the number of examples (in this case, 3).",[37,9226,9227,72,9296,9365],{},[383,9228,9230,9247],{"className":9229},[1545],[383,9231,9233],{"className":9232},[1549],[1551,9234,9235],{"xmlns":1553},[1555,9236,9237,9245],{},[1558,9238,9239],{},[1935,9240,9241,9243],{},[1938,9242,1940],{},[1938,9244,2363],{},[1569,9246,2366],{"encoding":1571},[383,9248,9250],{"className":9249,"ariaHidden":1577},[1576],[383,9251,9253,9256],{"className":9252},[1581],[383,9254],{"className":9255,"style":2376},[1585],[383,9257,9259,9262],{"className":9258},[1590],[383,9260,1940],{"className":9261},[1590,2033],[383,9263,9265],{"className":9264},[2037],[383,9266,9268,9288],{"className":9267},[2041,2042],[383,9269,9271,9285],{"className":9270},[2046],[383,9272,9274],{"className":9273,"style":2395},[2050],[383,9275,9276,9279],{"style":2054},[383,9277],{"className":9278,"style":2059},[2058],[383,9280,9282],{"className":9281},[2063,2064,2065,2066],[383,9283,2363],{"className":9284},[1590,2033,2066],[383,9286,2074],{"className":9287},[2073],[383,9289,9291],{"className":9290},[2046],[383,9292,9294],{"className":9293,"style":2081},[2050],[383,9295],{},[383,9297,9299,9316],{"className":9298},[1545],[383,9300,9302],{"className":9301},[1549],[1551,9303,9304],{"xmlns":1553},[1555,9305,9306,9314],{},[1558,9307,9308],{},[1935,9309,9310,9312],{},[1938,9311,1950],{},[1938,9313,2363],{},[1569,9315,2439],{"encoding":1571},[383,9317,9319],{"className":9318,"ariaHidden":1577},[1576],[383,9320,9322,9325],{"className":9321},[1581],[383,9323],{"className":9324,"style":2449},[1585],[383,9326,9328,9331],{"className":9327},[1590],[383,9329,1950],{"className":9330,"style":2096},[1590,2033],[383,9332,9334],{"className":9333},[2037],[383,9335,9337,9357],{"className":9336},[2041,2042],[383,9338,9340,9354],{"className":9339},[2046],[383,9341,9343],{"className":9342,"style":2395},[2050],[383,9344,9345,9348],{"style":2111},[383,9346],{"className":9347,"style":2059},[2058],[383,9349,9351],{"className":9350},[2063,2064,2065,2066],[383,9352,2363],{"className":9353},[1590,2033,2066],[383,9355,2074],{"className":9356},[2073],[383,9358,9360],{"className":9359},[2046],[383,9361,9363],{"className":9362,"style":2081},[2050],[383,9364],{}," are the values of size and price for each example.",[37,9367,9368,72,9428,9499],{},[383,9369,9371,9388],{"className":9370},[1545],[383,9372,9374],{"className":9373},[1549],[1551,9375,9376],{"xmlns":1553},[1555,9377,9378,9386],{},[1558,9379,9380],{},[4422,9381,9382,9384],{"accent":1577},[1938,9383,1940],{},[1565,9385,7238],{},[1569,9387,7647],{"encoding":1571},[383,9389,9391],{"className":9390,"ariaHidden":1577},[1576],[383,9392,9394,9397],{"className":9393},[1581],[383,9395],{"className":9396,"style":7332},[1585],[383,9398,9400],{"className":9399},[1590,4570],[383,9401,9403],{"className":9402},[2041],[383,9404,9406],{"className":9405},[2046],[383,9407,9409,9417],{"className":9408,"style":7332},[2050],[383,9410,9411,9414],{"style":4583},[383,9412],{"className":9413,"style":4587},[2058],[383,9415,1940],{"className":9416},[1590,2033],[383,9418,9419,9422],{"style":4583},[383,9420],{"className":9421,"style":4587},[2058],[383,9423,9425],{"className":9424,"style":7446},[4637],[383,9426,7238],{"className":9427},[1590],[383,9429,9431,9448],{"className":9430},[1545],[383,9432,9434],{"className":9433},[1549],[1551,9435,9436],{"xmlns":1553},[1555,9437,9438,9446],{},[1558,9439,9440],{},[4422,9441,9442,9444],{"accent":1577},[1938,9443,1950],{},[1565,9445,7238],{},[1569,9447,7708],{"encoding":1571},[383,9449,9451],{"className":9450,"ariaHidden":1577},[1576],[383,9452,9454,9457],{"className":9453},[1581],[383,9455],{"className":9456,"style":7718},[1585],[383,9458,9460],{"className":9459},[1590,4570],[383,9461,9463,9491],{"className":9462},[2041,2042],[383,9464,9466,9488],{"className":9465},[2046],[383,9467,9469,9477],{"className":9468,"style":7332},[2050],[383,9470,9471,9474],{"style":4583},[383,9472],{"className":9473,"style":4587},[2058],[383,9475,1950],{"className":9476,"style":2096},[1590,2033],[383,9478,9479,9482],{"style":4583},[383,9480],{"className":9481,"style":4587},[2058],[383,9483,9485],{"className":9484,"style":5636},[4637],[383,9486,7238],{"className":9487},[1590],[383,9489,2074],{"className":9490},[2073],[383,9492,9494],{"className":9493},[2046],[383,9495,9497],{"className":9496,"style":4651},[2050],[383,9498],{}," are the means of the independent and dependent variables, respectively.",[11,9501,9502],{},"We have then for this case:",[383,9504,9506],{"className":9505},[2494],[383,9507,9509,9646],{"className":9508},[1545],[383,9510,9512],{"className":9511},[1549],[1551,9513,9514],{"xmlns":1553,"display":2503},[1555,9515,9516,9643],{},[1558,9517,9518,9524,9526],{},[1935,9519,9520,9522],{},[1938,9521,2910],{},[1561,9523,1943],{},[1565,9525,1567],{},[5025,9527,9528,9593],{},[1558,9529,9530,9533,9535,9537,9540,9543,9545,9547,9549,9552,9554,9556,9558,9561,9563,9565,9567,9569,9571,9573,9575,9577,9579,9581,9583,9585,9587,9589,9591],{},[1561,9531,9532],{},"3",[1565,9534,1933],{"stretchy":1929},[1561,9536,7783],{},[1565,9538,9539],{},"∗",[1561,9541,9542],{},"100000",[1565,9544,2916],{},[1561,9546,7791],{},[1565,9548,9539],{},[1561,9550,9551],{},"200000",[1565,9553,2916],{},[1561,9555,7799],{},[1565,9557,9539],{},[1561,9559,9560],{},"300000",[1565,9562,1955],{"stretchy":1929},[1565,9564,1680],{},[1565,9566,1933],{"stretchy":1929},[1561,9568,7783],{},[1565,9570,2916],{},[1561,9572,7791],{},[1565,9574,2916],{},[1561,9576,7799],{},[1565,9578,1955],{"stretchy":1929},[1565,9580,1933],{"stretchy":1929},[1561,9582,9542],{},[1565,9584,2916],{},[1561,9586,9551],{},[1565,9588,2916],{},[1561,9590,9560],{},[1565,9592,1955],{"stretchy":1929},[1558,9594,9595,9597,9599,9605,9607,9613,9615,9621,9623,9625,9627,9629,9631,9633,9635,9637],{},[1561,9596,9532],{},[1565,9598,1933],{"stretchy":1929},[5068,9600,9601,9603],{},[1561,9602,7783],{},[1561,9604,1563],{},[1565,9606,2916],{},[5068,9608,9609,9611],{},[1561,9610,7791],{},[1561,9612,1563],{},[1565,9614,2916],{},[5068,9616,9617,9619],{},[1561,9618,7799],{},[1561,9620,1563],{},[1565,9622,1955],{"stretchy":1929},[1565,9624,1680],{},[1565,9626,1933],{"stretchy":1929},[1561,9628,7783],{},[1565,9630,2916],{},[1561,9632,7791],{},[1565,9634,2916],{},[1561,9636,7799],{},[5068,9638,9639,9641],{},[1565,9640,1955],{"stretchy":1929},[1561,9642,1563],{},[1569,9644,9645],{"encoding":1571},"\\beta_1 = \\frac{3(50*100000 + 100*200000 + 150*300000) - (50 + 100 + 150)(100000 + 200000 + 300000)}{3(50^2 + 100^2 + 150^2) - (50 + 100 + 150)^2}",[383,9647,9649,9704],{"className":9648,"ariaHidden":1577},[1576],[383,9650,9652,9655,9695,9698,9701],{"className":9651},[1581],[383,9653],{"className":9654,"style":2534},[1585],[383,9656,9658,9661],{"className":9657},[1590],[383,9659,2910],{"className":9660,"style":3006},[1590,2033],[383,9662,9664],{"className":9663},[2037],[383,9665,9667,9687],{"className":9666},[2041,2042],[383,9668,9670,9684],{"className":9669},[2046],[383,9671,9673],{"className":9672,"style":2051},[2050],[383,9674,9675,9678],{"style":3021},[383,9676],{"className":9677,"style":2059},[2058],[383,9679,9681],{"className":9680},[2063,2064,2065,2066],[383,9682,1943],{"className":9683},[1590,2066],[383,9685,2074],{"className":9686},[2073],[383,9688,9690],{"className":9689},[2046],[383,9691,9693],{"className":9692,"style":2081},[2050],[383,9694],{},[383,9696],{"className":9697,"style":1595},[1594],[383,9699,1567],{"className":9700},[1599],[383,9702],{"className":9703,"style":1595},[1594],[383,9705,9707,9711],{"className":9706},[1581],[383,9708],{"className":9709,"style":9710},[1585],"height:2.363em;vertical-align:-0.936em;",[383,9712,9714,9717,10106],{"className":9713},[1590],[383,9715],{"className":9716},[2025,5119],[383,9718,9720],{"className":9719},[5025],[383,9721,9723,10097],{"className":9722},[2041,2042],[383,9724,9726,10094],{"className":9725},[2046],[383,9727,9729,9931,9939],{"className":9728,"style":6809},[2050],[383,9730,9731,9734],{"style":5135},[383,9732],{"className":9733,"style":4587},[2058],[383,9735,9737,9740,9743,9747,9776,9779,9782,9785,9789,9818,9821,9824,9827,9831,9860,9863,9866,9869,9872,9875,9878,9881,9884,9887,9890,9893,9896,9899,9902],{"className":9736},[1590],[383,9738,9532],{"className":9739},[1590],[383,9741,1933],{"className":9742},[2025],[383,9744,9746],{"className":9745},[1590],"5",[383,9748,9750,9753],{"className":9749},[1590],[383,9751,2913],{"className":9752},[1590],[383,9754,9756],{"className":9755},[2037],[383,9757,9759],{"className":9758},[2041],[383,9760,9762],{"className":9761},[2046],[383,9763,9765],{"className":9764,"style":6966},[2050],[383,9766,9767,9770],{"style":6969},[383,9768],{"className":9769,"style":2059},[2058],[383,9771,9773],{"className":9772},[2063,2064,2065,2066],[383,9774,1563],{"className":9775},[1590,2066],[383,9777],{"className":9778,"style":2577},[1594],[383,9780,2916],{"className":9781},[3048],[383,9783],{"className":9784,"style":2577},[1594],[383,9786,9788],{"className":9787},[1590],"10",[383,9790,9792,9795],{"className":9791},[1590],[383,9793,2913],{"className":9794},[1590],[383,9796,9798],{"className":9797},[2037],[383,9799,9801],{"className":9800},[2041],[383,9802,9804],{"className":9803},[2046],[383,9805,9807],{"className":9806,"style":6966},[2050],[383,9808,9809,9812],{"style":6969},[383,9810],{"className":9811,"style":2059},[2058],[383,9813,9815],{"className":9814},[2063,2064,2065,2066],[383,9816,1563],{"className":9817},[1590,2066],[383,9819],{"className":9820,"style":2577},[1594],[383,9822,2916],{"className":9823},[3048],[383,9825],{"className":9826,"style":2577},[1594],[383,9828,9830],{"className":9829},[1590],"15",[383,9832,9834,9837],{"className":9833},[1590],[383,9835,2913],{"className":9836},[1590],[383,9838,9840],{"className":9839},[2037],[383,9841,9843],{"className":9842},[2041],[383,9844,9846],{"className":9845},[2046],[383,9847,9849],{"className":9848,"style":6966},[2050],[383,9850,9851,9854],{"style":6969},[383,9852],{"className":9853,"style":2059},[2058],[383,9855,9857],{"className":9856},[2063,2064,2065,2066],[383,9858,1563],{"className":9859},[1590,2066],[383,9861,1955],{"className":9862},[2135],[383,9864],{"className":9865,"style":2577},[1594],[383,9867,1680],{"className":9868},[3048],[383,9870],{"className":9871,"style":2577},[1594],[383,9873,1933],{"className":9874},[2025],[383,9876,7783],{"className":9877},[1590],[383,9879],{"className":9880,"style":2577},[1594],[383,9882,2916],{"className":9883},[3048],[383,9885],{"className":9886,"style":2577},[1594],[383,9888,7791],{"className":9889},[1590],[383,9891],{"className":9892,"style":2577},[1594],[383,9894,2916],{"className":9895},[3048],[383,9897],{"className":9898,"style":2577},[1594],[383,9900,7799],{"className":9901},[1590],[383,9903,9905,9908],{"className":9904},[2135],[383,9906,1955],{"className":9907},[2135],[383,9909,9911],{"className":9910},[2037],[383,9912,9914],{"className":9913},[2041],[383,9915,9917],{"className":9916},[2046],[383,9918,9920],{"className":9919,"style":6966},[2050],[383,9921,9922,9925],{"style":6969},[383,9923],{"className":9924,"style":2059},[2058],[383,9926,9928],{"className":9927},[2063,2064,2065,2066],[383,9929,1563],{"className":9930},[1590,2066],[383,9932,9933,9936],{"style":5147},[383,9934],{"className":9935,"style":4587},[2058],[383,9937],{"className":9938,"style":5155},[5154],[383,9940,9941,9944],{"style":5158},[383,9942],{"className":9943,"style":4587},[2058],[383,9945,9947,9950,9953,9956,9959,9962,9965,9968,9971,9974,9977,9980,9983,9986,9989,9992,9995,9998,10001,10004,10007,10010,10013,10016,10019,10022,10025,10028,10031,10034,10037,10040,10043,10046,10049,10052,10055,10058,10061,10064,10067,10070,10073,10076,10079,10082,10085,10088,10091],{"className":9946},[1590],[383,9948,9532],{"className":9949},[1590],[383,9951,1933],{"className":9952},[2025],[383,9954,7783],{"className":9955},[1590],[383,9957],{"className":9958,"style":2577},[1594],[383,9960,9539],{"className":9961},[3048],[383,9963],{"className":9964,"style":2577},[1594],[383,9966,9542],{"className":9967},[1590],[383,9969],{"className":9970,"style":2577},[1594],[383,9972,2916],{"className":9973},[3048],[383,9975],{"className":9976,"style":2577},[1594],[383,9978,7791],{"className":9979},[1590],[383,9981],{"className":9982,"style":2577},[1594],[383,9984,9539],{"className":9985},[3048],[383,9987],{"className":9988,"style":2577},[1594],[383,9990,9551],{"className":9991},[1590],[383,9993],{"className":9994,"style":2577},[1594],[383,9996,2916],{"className":9997},[3048],[383,9999],{"className":10000,"style":2577},[1594],[383,10002,7799],{"className":10003},[1590],[383,10005],{"className":10006,"style":2577},[1594],[383,10008,9539],{"className":10009},[3048],[383,10011],{"className":10012,"style":2577},[1594],[383,10014,9560],{"className":10015},[1590],[383,10017,1955],{"className":10018},[2135],[383,10020],{"className":10021,"style":2577},[1594],[383,10023,1680],{"className":10024},[3048],[383,10026],{"className":10027,"style":2577},[1594],[383,10029,1933],{"className":10030},[2025],[383,10032,7783],{"className":10033},[1590],[383,10035],{"className":10036,"style":2577},[1594],[383,10038,2916],{"className":10039},[3048],[383,10041],{"className":10042,"style":2577},[1594],[383,10044,7791],{"className":10045},[1590],[383,10047],{"className":10048,"style":2577},[1594],[383,10050,2916],{"className":10051},[3048],[383,10053],{"className":10054,"style":2577},[1594],[383,10056,7799],{"className":10057},[1590],[383,10059,1955],{"className":10060},[2135],[383,10062,1933],{"className":10063},[2025],[383,10065,9542],{"className":10066},[1590],[383,10068],{"className":10069,"style":2577},[1594],[383,10071,2916],{"className":10072},[3048],[383,10074],{"className":10075,"style":2577},[1594],[383,10077,9551],{"className":10078},[1590],[383,10080],{"className":10081,"style":2577},[1594],[383,10083,2916],{"className":10084},[3048],[383,10086],{"className":10087,"style":2577},[1594],[383,10089,9560],{"className":10090},[1590],[383,10092,1955],{"className":10093},[2135],[383,10095,2074],{"className":10096},[2073],[383,10098,10100],{"className":10099},[2046],[383,10101,10104],{"className":10102,"style":10103},[2050],"height:0.936em;",[383,10105],{},[383,10107],{"className":10108},[2135,5119],[383,10110,10112],{"className":10111},[2494],[383,10113,10115,10175],{"className":10114},[1545],[383,10116,10118],{"className":10117},[1549],[1551,10119,10120],{"xmlns":1553,"display":2503},[1555,10121,10122,10172],{},[1558,10123,10124,10130,10132,10148,10150,10156],{},[1935,10125,10126,10128],{},[1938,10127,2910],{},[1561,10129,2913],{},[1565,10131,1567],{},[5025,10133,10134,10146],{},[1558,10135,10136,10138,10140,10142,10144],{},[1561,10137,9542],{},[1565,10139,2916],{},[1561,10141,9551],{},[1565,10143,2916],{},[1561,10145,9560],{},[1561,10147,9532],{},[1565,10149,1680],{},[1935,10151,10152,10154],{},[1938,10153,2910],{},[1561,10155,1943],{},[5025,10157,10158,10170],{},[1558,10159,10160,10162,10164,10166,10168],{},[1561,10161,7783],{},[1565,10163,2916],{},[1561,10165,7791],{},[1565,10167,2916],{},[1561,10169,7799],{},[1561,10171,9532],{},[1569,10173,10174],{"encoding":1571},"\\beta_0 = \\frac{100000 + 200000 + 300000}{3} - \\beta_1 \\frac{50 + 100 + 150}{3}",[383,10176,10178,10233,10335],{"className":10177,"ariaHidden":1577},[1576],[383,10179,10181,10184,10224,10227,10230],{"className":10180},[1581],[383,10182],{"className":10183,"style":2534},[1585],[383,10185,10187,10190],{"className":10186},[1590],[383,10188,2910],{"className":10189,"style":3006},[1590,2033],[383,10191,10193],{"className":10192},[2037],[383,10194,10196,10216],{"className":10195},[2041,2042],[383,10197,10199,10213],{"className":10198},[2046],[383,10200,10202],{"className":10201,"style":2051},[2050],[383,10203,10204,10207],{"style":3021},[383,10205],{"className":10206,"style":2059},[2058],[383,10208,10210],{"className":10209},[2063,2064,2065,2066],[383,10211,2913],{"className":10212},[1590,2066],[383,10214,2074],{"className":10215},[2073],[383,10217,10219],{"className":10218},[2046],[383,10220,10222],{"className":10221,"style":2081},[2050],[383,10223],{},[383,10225],{"className":10226,"style":1595},[1594],[383,10228,1567],{"className":10229},[1599],[383,10231],{"className":10232,"style":1595},[1594],[383,10234,10236,10240,10326,10329,10332],{"className":10235},[1581],[383,10237],{"className":10238,"style":10239},[1585],"height:2.0074em;vertical-align:-0.686em;",[383,10241,10243,10246,10323],{"className":10242},[1590],[383,10244],{"className":10245},[2025,5119],[383,10247,10249],{"className":10248},[5025],[383,10250,10252,10315],{"className":10251},[2041,2042],[383,10253,10255,10312],{"className":10254},[2046],[383,10256,10258,10269,10277],{"className":10257,"style":5132},[2050],[383,10259,10260,10263],{"style":5135},[383,10261],{"className":10262,"style":4587},[2058],[383,10264,10266],{"className":10265},[1590],[383,10267,9532],{"className":10268},[1590],[383,10270,10271,10274],{"style":5147},[383,10272],{"className":10273,"style":4587},[2058],[383,10275],{"className":10276,"style":5155},[5154],[383,10278,10279,10282],{"style":5158},[383,10280],{"className":10281,"style":4587},[2058],[383,10283,10285,10288,10291,10294,10297,10300,10303,10306,10309],{"className":10284},[1590],[383,10286,9542],{"className":10287},[1590],[383,10289],{"className":10290,"style":2577},[1594],[383,10292,2916],{"className":10293},[3048],[383,10295],{"className":10296,"style":2577},[1594],[383,10298,9551],{"className":10299},[1590],[383,10301],{"className":10302,"style":2577},[1594],[383,10304,2916],{"className":10305},[3048],[383,10307],{"className":10308,"style":2577},[1594],[383,10310,9560],{"className":10311},[1590],[383,10313,2074],{"className":10314},[2073],[383,10316,10318],{"className":10317},[2046],[383,10319,10321],{"className":10320,"style":5177},[2050],[383,10322],{},[383,10324],{"className":10325},[2135,5119],[383,10327],{"className":10328,"style":2577},[1594],[383,10330,1680],{"className":10331},[3048],[383,10333],{"className":10334,"style":2577},[1594],[383,10336,10338,10341,10381],{"className":10337},[1581],[383,10339],{"className":10340,"style":10239},[1585],[383,10342,10344,10347],{"className":10343},[1590],[383,10345,2910],{"className":10346,"style":3006},[1590,2033],[383,10348,10350],{"className":10349},[2037],[383,10351,10353,10373],{"className":10352},[2041,2042],[383,10354,10356,10370],{"className":10355},[2046],[383,10357,10359],{"className":10358,"style":2051},[2050],[383,10360,10361,10364],{"style":3021},[383,10362],{"className":10363,"style":2059},[2058],[383,10365,10367],{"className":10366},[2063,2064,2065,2066],[383,10368,1943],{"className":10369},[1590,2066],[383,10371,2074],{"className":10372},[2073],[383,10374,10376],{"className":10375},[2046],[383,10377,10379],{"className":10378,"style":2081},[2050],[383,10380],{},[383,10382,10384,10387,10464],{"className":10383},[1590],[383,10385],{"className":10386},[2025,5119],[383,10388,10390],{"className":10389},[5025],[383,10391,10393,10456],{"className":10392},[2041,2042],[383,10394,10396,10453],{"className":10395},[2046],[383,10397,10399,10410,10418],{"className":10398,"style":5132},[2050],[383,10400,10401,10404],{"style":5135},[383,10402],{"className":10403,"style":4587},[2058],[383,10405,10407],{"className":10406},[1590],[383,10408,9532],{"className":10409},[1590],[383,10411,10412,10415],{"style":5147},[383,10413],{"className":10414,"style":4587},[2058],[383,10416],{"className":10417,"style":5155},[5154],[383,10419,10420,10423],{"style":5158},[383,10421],{"className":10422,"style":4587},[2058],[383,10424,10426,10429,10432,10435,10438,10441,10444,10447,10450],{"className":10425},[1590],[383,10427,7783],{"className":10428},[1590],[383,10430],{"className":10431,"style":2577},[1594],[383,10433,2916],{"className":10434},[3048],[383,10436],{"className":10437,"style":2577},[1594],[383,10439,7791],{"className":10440},[1590],[383,10442],{"className":10443,"style":2577},[1594],[383,10445,2916],{"className":10446},[3048],[383,10448],{"className":10449,"style":2577},[1594],[383,10451,7799],{"className":10452},[1590],[383,10454,2074],{"className":10455},[2073],[383,10457,10459],{"className":10458},[2046],[383,10460,10462],{"className":10461,"style":5177},[2050],[383,10463],{},[383,10465],{"className":10466},[2135,5119],[11,10468,10469,10470,72,10562,10655],{},"Solving these formulas, we obtain the values ​​of ",[383,10471,10473,10495],{"className":10472},[1545],[383,10474,10476],{"className":10475},[1549],[1551,10477,10478],{"xmlns":1553},[1555,10479,10480,10492],{},[1558,10481,10482,10488,10490],{},[1935,10483,10484,10486],{},[1938,10485,2910],{},[1561,10487,2913],{},[1565,10489,1567],{},[1561,10491,2913],{},[1569,10493,10494],{"encoding":1571},"\\beta_0 = 0",[383,10496,10498,10553],{"className":10497,"ariaHidden":1577},[1576],[383,10499,10501,10504,10544,10547,10550],{"className":10500},[1581],[383,10502],{"className":10503,"style":2534},[1585],[383,10505,10507,10510],{"className":10506},[1590],[383,10508,2910],{"className":10509,"style":3006},[1590,2033],[383,10511,10513],{"className":10512},[2037],[383,10514,10516,10536],{"className":10515},[2041,2042],[383,10517,10519,10533],{"className":10518},[2046],[383,10520,10522],{"className":10521,"style":2051},[2050],[383,10523,10524,10527],{"style":3021},[383,10525],{"className":10526,"style":2059},[2058],[383,10528,10530],{"className":10529},[2063,2064,2065,2066],[383,10531,2913],{"className":10532},[1590,2066],[383,10534,2074],{"className":10535},[2073],[383,10537,10539],{"className":10538},[2046],[383,10540,10542],{"className":10541,"style":2081},[2050],[383,10543],{},[383,10545],{"className":10546,"style":1595},[1594],[383,10548,1567],{"className":10549},[1599],[383,10551],{"className":10552,"style":1595},[1594],[383,10554,10556,10559],{"className":10555},[1581],[383,10557],{"className":10558,"style":1586},[1585],[383,10560,2913],{"className":10561},[1590],[383,10563,10565,10588],{"className":10564},[1545],[383,10566,10568],{"className":10567},[1549],[1551,10569,10570],{"xmlns":1553},[1555,10571,10572,10585],{},[1558,10573,10574,10580,10582],{},[1935,10575,10576,10578],{},[1938,10577,2910],{},[1561,10579,1943],{},[1565,10581,1567],{},[1561,10583,10584],{},"2000",[1569,10586,10587],{"encoding":1571},"\\beta_1 = 2000",[383,10589,10591,10646],{"className":10590,"ariaHidden":1577},[1576],[383,10592,10594,10597,10637,10640,10643],{"className":10593},[1581],[383,10595],{"className":10596,"style":2534},[1585],[383,10598,10600,10603],{"className":10599},[1590],[383,10601,2910],{"className":10602,"style":3006},[1590,2033],[383,10604,10606],{"className":10605},[2037],[383,10607,10609,10629],{"className":10608},[2041,2042],[383,10610,10612,10626],{"className":10611},[2046],[383,10613,10615],{"className":10614,"style":2051},[2050],[383,10616,10617,10620],{"style":3021},[383,10618],{"className":10619,"style":2059},[2058],[383,10621,10623],{"className":10622},[2063,2064,2065,2066],[383,10624,1943],{"className":10625},[1590,2066],[383,10627,2074],{"className":10628},[2073],[383,10630,10632],{"className":10631},[2046],[383,10633,10635],{"className":10634,"style":2081},[2050],[383,10636],{},[383,10638],{"className":10639,"style":1595},[1594],[383,10641,1567],{"className":10642},[1599],[383,10644],{"className":10645,"style":1595},[1594],[383,10647,10649,10652],{"className":10648},[1581],[383,10650],{"className":10651,"style":1586},[1585],[383,10653,10584],{"className":10654},[1590],", which allow us to build the following model:",[383,10657,10659],{"className":10658},[2494],[383,10660,10662,10690],{"className":10661},[1545],[383,10663,10665],{"className":10664},[1549],[1551,10666,10667],{"xmlns":1553,"display":2503},[1555,10668,10669,10687],{},[1558,10670,10671,10677,10679,10681,10683,10685],{},[4422,10672,10673,10675],{"accent":1577},[1938,10674,1950],{},[1565,10676,4432],{},[1565,10678,1567],{},[1561,10680,2913],{},[1565,10682,2916],{},[1561,10684,10584],{},[1938,10686,1940],{},[1569,10688,10689],{"encoding":1571},"\\hat{y} = 0 + 2000x",[383,10691,10693,10750,10769],{"className":10692,"ariaHidden":1577},[1576],[383,10694,10696,10699,10741,10744,10747],{"className":10695},[1581],[383,10697],{"className":10698,"style":2534},[1585],[383,10700,10702],{"className":10701},[1590,4570],[383,10703,10705,10733],{"className":10704},[2041,2042],[383,10706,10708,10730],{"className":10707},[2046],[383,10709,10711,10719],{"className":10710,"style":5334},[2050],[383,10712,10713,10716],{"style":4583},[383,10714],{"className":10715,"style":4587},[2058],[383,10717,1950],{"className":10718,"style":2096},[1590,2033],[383,10720,10721,10724],{"style":4583},[383,10722],{"className":10723,"style":4587},[2058],[383,10725,10727],{"className":10726,"style":5636},[4637],[383,10728,4432],{"className":10729},[1590],[383,10731,2074],{"className":10732},[2073],[383,10734,10736],{"className":10735},[2046],[383,10737,10739],{"className":10738,"style":4651},[2050],[383,10740],{},[383,10742],{"className":10743,"style":1595},[1594],[383,10745,1567],{"className":10746},[1599],[383,10748],{"className":10749,"style":1595},[1594],[383,10751,10753,10757,10760,10763,10766],{"className":10752},[1581],[383,10754],{"className":10755,"style":10756},[1585],"height:0.7278em;vertical-align:-0.0833em;",[383,10758,2913],{"className":10759},[1590],[383,10761],{"className":10762,"style":2577},[1594],[383,10764,2916],{"className":10765},[3048],[383,10767],{"className":10768,"style":2577},[1594],[383,10770,10772,10775,10778],{"className":10771},[1581],[383,10773],{"className":10774,"style":1586},[1585],[383,10776,10584],{"className":10777},[1590],[383,10779,1940],{"className":10780},[1590,2033],[383,10782,10784],{"className":10783},[2494],[383,10785,10787,10811],{"className":10786},[1545],[383,10788,10790],{"className":10789},[1549],[1551,10791,10792],{"xmlns":1553,"display":2503},[1555,10793,10794,10808],{},[1558,10795,10796,10802,10804,10806],{},[4422,10797,10798,10800],{"accent":1577},[1938,10799,1950],{},[1565,10801,4432],{},[1565,10803,1567],{},[1561,10805,10584],{},[1938,10807,1940],{},[1569,10809,10810],{"encoding":1571},"\\hat{y} = 2000x",[383,10812,10814,10871],{"className":10813,"ariaHidden":1577},[1576],[383,10815,10817,10820,10862,10865,10868],{"className":10816},[1581],[383,10818],{"className":10819,"style":2534},[1585],[383,10821,10823],{"className":10822},[1590,4570],[383,10824,10826,10854],{"className":10825},[2041,2042],[383,10827,10829,10851],{"className":10828},[2046],[383,10830,10832,10840],{"className":10831,"style":5334},[2050],[383,10833,10834,10837],{"style":4583},[383,10835],{"className":10836,"style":4587},[2058],[383,10838,1950],{"className":10839,"style":2096},[1590,2033],[383,10841,10842,10845],{"style":4583},[383,10843],{"className":10844,"style":4587},[2058],[383,10846,10848],{"className":10847,"style":5636},[4637],[383,10849,4432],{"className":10850},[1590],[383,10852,2074],{"className":10853},[2073],[383,10855,10857],{"className":10856},[2046],[383,10858,10860],{"className":10859,"style":4651},[2050],[383,10861],{},[383,10863],{"className":10864,"style":1595},[1594],[383,10866,1567],{"className":10867},[1599],[383,10869],{"className":10870,"style":1595},[1594],[383,10872,10874,10877,10880],{"className":10873},[1581],[383,10875],{"className":10876,"style":1586},[1585],[383,10878,10584],{"className":10879},[1590],[383,10881,1940],{"className":10882},[1590,2033],[11,10884,10885],{},"We can now make predictions for new size values. For example, for a 120 m² house, the model predicts a price of:",[383,10887,10889],{"className":10888},[2494],[383,10890,10892,10928],{"className":10891},[1545],[383,10893,10895],{"className":10894},[1549],[1551,10896,10897],{"xmlns":1553,"display":2503},[1555,10898,10899,10925],{},[1558,10900,10901,10907,10909,10911,10913,10916,10918,10921,10923],{},[4422,10902,10903,10905],{"accent":1577},[1938,10904,1950],{},[1565,10906,4432],{},[1565,10908,1567],{},[1561,10910,10584],{},[1565,10912,9539],{},[1561,10914,10915],{},"120",[1565,10917,1567],{},[1561,10919,10920],{},"240",[1565,10922,1674],{"separator":1577},[1561,10924,1677],{},[1569,10926,10927],{"encoding":1571},"\\hat{y} = 2000 * 120 = 240,000",[383,10929,10931,10988,11006,11024],{"className":10930,"ariaHidden":1577},[1576],[383,10932,10934,10937,10979,10982,10985],{"className":10933},[1581],[383,10935],{"className":10936,"style":2534},[1585],[383,10938,10940],{"className":10939},[1590,4570],[383,10941,10943,10971],{"className":10942},[2041,2042],[383,10944,10946,10968],{"className":10945},[2046],[383,10947,10949,10957],{"className":10948,"style":5334},[2050],[383,10950,10951,10954],{"style":4583},[383,10952],{"className":10953,"style":4587},[2058],[383,10955,1950],{"className":10956,"style":2096},[1590,2033],[383,10958,10959,10962],{"style":4583},[383,10960],{"className":10961,"style":4587},[2058],[383,10963,10965],{"className":10964,"style":5636},[4637],[383,10966,4432],{"className":10967},[1590],[383,10969,2074],{"className":10970},[2073],[383,10972,10974],{"className":10973},[2046],[383,10975,10977],{"className":10976,"style":4651},[2050],[383,10978],{},[383,10980],{"className":10981,"style":1595},[1594],[383,10983,1567],{"className":10984},[1599],[383,10986],{"className":10987,"style":1595},[1594],[383,10989,10991,10994,10997,11000,11003],{"className":10990},[1581],[383,10992],{"className":10993,"style":1586},[1585],[383,10995,10584],{"className":10996},[1590],[383,10998],{"className":10999,"style":2577},[1594],[383,11001,9539],{"className":11002},[3048],[383,11004],{"className":11005,"style":2577},[1594],[383,11007,11009,11012,11015,11018,11021],{"className":11008},[1581],[383,11010],{"className":11011,"style":1586},[1585],[383,11013,10915],{"className":11014},[1590],[383,11016],{"className":11017,"style":1595},[1594],[383,11019,1567],{"className":11020},[1599],[383,11022],{"className":11023,"style":1595},[1594],[383,11025,11027,11030,11033,11036,11039],{"className":11026},[1581],[383,11028],{"className":11029,"style":1693},[1585],[383,11031,10920],{"className":11032},[1590],[383,11034,1674],{"className":11035},[1700],[383,11037],{"className":11038,"style":1704},[1594],[383,11040,1677],{"className":11041},[1590],[11,11043,11044,11045,11048],{},"Our calculations have yielded the best coefficients that ",[40,11046,11047],{},"minimize"," the mean squared error (but do not eliminate it completely). To measure the error of our model, we can calculate the MSE using the formula mentioned earlier:",[383,11050,11052],{"className":11051},[2494],[383,11053,11055,11120],{"className":11054},[1545],[383,11056,11058],{"className":11057},[1549],[1551,11059,11060],{"xmlns":1553,"display":2503},[1555,11061,11062,11118],{},[1558,11063,11064,11066,11068,11070,11072,11078,11092,11094,11100,11102,11112],{},[1938,11065,5015],{},[1938,11067,5018],{},[1938,11069,5021],{},[1565,11071,1567],{},[5025,11073,11074,11076],{},[1561,11075,1943],{},[1938,11077,1995],{},[5032,11079,11080,11082,11090],{},[1565,11081,5036],{},[1558,11083,11084,11086,11088],{},[1938,11085,2363],{},[1565,11087,1567],{},[1561,11089,1943],{},[1938,11091,1995],{},[1565,11093,1933],{"stretchy":1929},[1935,11095,11096,11098],{},[1938,11097,1950],{},[1938,11099,2363],{},[1565,11101,1680],{},[4422,11103,11104,11110],{"accent":1577},[1935,11105,11106,11108],{},[1938,11107,1950],{},[1938,11109,2363],{},[1565,11111,4432],{},[5068,11113,11114,11116],{},[1565,11115,1955],{"stretchy":1929},[1561,11117,1563],{},[1569,11119,5076],{"encoding":1571},[383,11121,11123,11147,11337],{"className":11122,"ariaHidden":1577},[1576],[383,11124,11126,11129,11132,11135,11138,11141,11144],{"className":11125},[1581],[383,11127],{"className":11128,"style":2554},[1585],[383,11130,5015],{"className":11131,"style":5089},[1590,2033],[383,11133,5018],{"className":11134,"style":5093},[1590,2033],[383,11136,5021],{"className":11137,"style":5093},[1590,2033],[383,11139],{"className":11140,"style":1595},[1594],[383,11142,1567],{"className":11143},[1599],[383,11145],{"className":11146,"style":1595},[1594],[383,11148,11150,11153,11215,11218,11285,11288,11328,11331,11334],{"className":11149},[1581],[383,11151],{"className":11152,"style":5112},[1585],[383,11154,11156,11159,11212],{"className":11155},[1590],[383,11157],{"className":11158},[2025,5119],[383,11160,11162],{"className":11161},[5025],[383,11163,11165,11204],{"className":11164},[2041,2042],[383,11166,11168,11201],{"className":11167},[2046],[383,11169,11171,11182,11190],{"className":11170,"style":5132},[2050],[383,11172,11173,11176],{"style":5135},[383,11174],{"className":11175,"style":4587},[2058],[383,11177,11179],{"className":11178},[1590],[383,11180,1995],{"className":11181},[1590,2033],[383,11183,11184,11187],{"style":5147},[383,11185],{"className":11186,"style":4587},[2058],[383,11188],{"className":11189,"style":5155},[5154],[383,11191,11192,11195],{"style":5158},[383,11193],{"className":11194,"style":4587},[2058],[383,11196,11198],{"className":11197},[1590],[383,11199,1943],{"className":11200},[1590],[383,11202,2074],{"className":11203},[2073],[383,11205,11207],{"className":11206},[2046],[383,11208,11210],{"className":11209,"style":5177},[2050],[383,11211],{},[383,11213],{"className":11214},[2135,5119],[383,11216],{"className":11217,"style":1704},[1594],[383,11219,11221],{"className":11220},[5189,5190],[383,11222,11224,11277],{"className":11223},[2041,2042],[383,11225,11227,11274],{"className":11226},[2046],[383,11228,11230,11250,11260],{"className":11229,"style":5200},[2050],[383,11231,11232,11235],{"style":5203},[383,11233],{"className":11234,"style":5207},[2058],[383,11236,11238],{"className":11237},[2063,2064,2065,2066],[383,11239,11241,11244,11247],{"className":11240},[1590,2066],[383,11242,2363],{"className":11243},[1590,2033,2066],[383,11245,1567],{"className":11246},[1599,2066],[383,11248,1943],{"className":11249},[1590,2066],[383,11251,11252,11255],{"style":5225},[383,11253],{"className":11254,"style":5207},[2058],[383,11256,11257],{},[383,11258,5036],{"className":11259},[5189,5234,5235],[383,11261,11262,11265],{"style":5238},[383,11263],{"className":11264,"style":5207},[2058],[383,11266,11268],{"className":11267},[2063,2064,2065,2066],[383,11269,11271],{"className":11270},[1590,2066],[383,11272,1995],{"className":11273},[1590,2033,2066],[383,11275,2074],{"className":11276},[2073],[383,11278,11280],{"className":11279},[2046],[383,11281,11283],{"className":11282,"style":5260},[2050],[383,11284],{},[383,11286,1933],{"className":11287},[2025],[383,11289,11291,11294],{"className":11290},[1590],[383,11292,1950],{"className":11293,"style":2096},[1590,2033],[383,11295,11297],{"className":11296},[2037],[383,11298,11300,11320],{"className":11299},[2041,2042],[383,11301,11303,11317],{"className":11302},[2046],[383,11304,11306],{"className":11305,"style":2395},[2050],[383,11307,11308,11311],{"style":2111},[383,11309],{"className":11310,"style":2059},[2058],[383,11312,11314],{"className":11313},[2063,2064,2065,2066],[383,11315,2363],{"className":11316},[1590,2033,2066],[383,11318,2074],{"className":11319},[2073],[383,11321,11323],{"className":11322},[2046],[383,11324,11326],{"className":11325,"style":2081},[2050],[383,11327],{},[383,11329],{"className":11330,"style":2577},[1594],[383,11332,1680],{"className":11333},[3048],[383,11335],{"className":11336,"style":2577},[1594],[383,11338,11340,11343,11422],{"className":11339},[1581],[383,11341],{"className":11342,"style":5321},[1585],[383,11344,11346],{"className":11345},[1590,4570],[383,11347,11349,11414],{"className":11348},[2041,2042],[383,11350,11352,11411],{"className":11351},[2046],[383,11353,11355,11400],{"className":11354,"style":5334},[2050],[383,11356,11357,11360],{"style":4583},[383,11358],{"className":11359,"style":4587},[2058],[383,11361,11363,11366],{"className":11362},[1590],[383,11364,1950],{"className":11365,"style":2096},[1590,2033],[383,11367,11369],{"className":11368},[2037],[383,11370,11372,11392],{"className":11371},[2041,2042],[383,11373,11375,11389],{"className":11374},[2046],[383,11376,11378],{"className":11377,"style":2395},[2050],[383,11379,11380,11383],{"style":2111},[383,11381],{"className":11382,"style":2059},[2058],[383,11384,11386],{"className":11385},[2063,2064,2065,2066],[383,11387,2363],{"className":11388},[1590,2033,2066],[383,11390,2074],{"className":11391},[2073],[383,11393,11395],{"className":11394},[2046],[383,11396,11398],{"className":11397,"style":2081},[2050],[383,11399],{},[383,11401,11402,11405],{"style":4583},[383,11403],{"className":11404,"style":4587},[2058],[383,11406,11408],{"className":11407,"style":4638},[4637],[383,11409,4432],{"className":11410},[1590],[383,11412,2074],{"className":11413},[2073],[383,11415,11417],{"className":11416},[2046],[383,11418,11420],{"className":11419,"style":4651},[2050],[383,11421],{},[383,11423,11425,11428],{"className":11424},[2135],[383,11426,1955],{"className":11427},[2135],[383,11429,11431],{"className":11430},[2037],[383,11432,11434],{"className":11433},[2041],[383,11435,11437],{"className":11436},[2046],[383,11438,11440],{"className":11439,"style":5420},[2050],[383,11441,11442,11445],{"style":5423},[383,11443],{"className":11444,"style":2059},[2058],[383,11446,11448],{"className":11447},[2063,2064,2065,2066],[383,11449,1563],{"className":11450},[1590,2066],[11,11452,3370],{},[34,11454,11455,11485,11557],{},[37,11456,11457,9224],{},[383,11458,11460,11473],{"className":11459},[1545],[383,11461,11463],{"className":11462},[1549],[1551,11464,11465],{"xmlns":1553},[1555,11466,11467,11471],{},[1558,11468,11469],{},[1938,11470,1995],{},[1569,11472,1995],{"encoding":1571},[383,11474,11476],{"className":11475,"ariaHidden":1577},[1576],[383,11477,11479,11482],{"className":11478},[1581],[383,11480],{"className":11481,"style":3364},[1585],[383,11483,1995],{"className":11484},[1590,2033],[37,11486,11487,11556],{},[383,11488,11490,11507],{"className":11489},[1545],[383,11491,11493],{"className":11492},[1549],[1551,11494,11495],{"xmlns":1553},[1555,11496,11497,11505],{},[1558,11498,11499],{},[1935,11500,11501,11503],{},[1938,11502,1950],{},[1938,11504,2363],{},[1569,11506,2439],{"encoding":1571},[383,11508,11510],{"className":11509,"ariaHidden":1577},[1576],[383,11511,11513,11516],{"className":11512},[1581],[383,11514],{"className":11515,"style":2449},[1585],[383,11517,11519,11522],{"className":11518},[1590],[383,11520,1950],{"className":11521,"style":2096},[1590,2033],[383,11523,11525],{"className":11524},[2037],[383,11526,11528,11548],{"className":11527},[2041,2042],[383,11529,11531,11545],{"className":11530},[2046],[383,11532,11534],{"className":11533,"style":2395},[2050],[383,11535,11536,11539],{"style":2111},[383,11537],{"className":11538,"style":2059},[2058],[383,11540,11542],{"className":11541},[2063,2064,2065,2066],[383,11543,2363],{"className":11544},[1590,2033,2066],[383,11546,2074],{"className":11547},[2073],[383,11549,11551],{"className":11550},[2046],[383,11552,11554],{"className":11553,"style":2081},[2050],[383,11555],{}," are the real values of price for each example.",[37,11558,11559,11671],{},[383,11560,11562,11583],{"className":11561},[1545],[383,11563,11565],{"className":11564},[1549],[1551,11566,11567],{"xmlns":1553},[1555,11568,11569,11581],{},[1558,11570,11571],{},[1935,11572,11573,11579],{},[4422,11574,11575,11577],{"accent":1577},[1938,11576,1950],{},[1565,11578,4432],{},[1938,11580,2363],{},[1569,11582,5595],{"encoding":1571},[383,11584,11586],{"className":11585,"ariaHidden":1577},[1576],[383,11587,11589,11592],{"className":11588},[1581],[383,11590],{"className":11591,"style":2534},[1585],[383,11593,11595,11637],{"className":11594},[1590],[383,11596,11598],{"className":11597},[1590,4570],[383,11599,11601,11629],{"className":11600},[2041,2042],[383,11602,11604,11626],{"className":11603},[2046],[383,11605,11607,11615],{"className":11606,"style":5334},[2050],[383,11608,11609,11612],{"style":4583},[383,11610],{"className":11611,"style":4587},[2058],[383,11613,1950],{"className":11614,"style":2096},[1590,2033],[383,11616,11617,11620],{"style":4583},[383,11618],{"className":11619,"style":4587},[2058],[383,11621,11623],{"className":11622,"style":5636},[4637],[383,11624,4432],{"className":11625},[1590],[383,11627,2074],{"className":11628},[2073],[383,11630,11632],{"className":11631},[2046],[383,11633,11635],{"className":11634,"style":4651},[2050],[383,11636],{},[383,11638,11640],{"className":11639},[2037],[383,11641,11643,11663],{"className":11642},[2041,2042],[383,11644,11646,11660],{"className":11645},[2046],[383,11647,11649],{"className":11648,"style":2395},[2050],[383,11650,11651,11654],{"style":2111},[383,11652],{"className":11653,"style":2059},[2058],[383,11655,11657],{"className":11656},[2063,2064,2065,2066],[383,11658,2363],{"className":11659},[1590,2033,2066],[383,11661,2074],{"className":11662},[2073],[383,11664,11666],{"className":11665},[2046],[383,11667,11669],{"className":11668,"style":2081},[2050],[383,11670],{}," are the model predictions for each example, which are calculated using the linear regression model.",[1008,11673,11674],{},[37,11675,11676],{},"We calculate the predictions for each example:",[34,11678,11679,11874,12070],{},[37,11680,11681,11682],{},"For 50 m²: ",[383,11683,11685,11723],{"className":11684},[1545],[383,11686,11688],{"className":11687},[1549],[1551,11689,11690],{"xmlns":1553},[1555,11691,11692,11720],{},[1558,11693,11694,11704,11706,11708,11710,11712,11714,11716,11718],{},[4422,11695,11696,11702],{"accent":1577},[1935,11697,11698,11700],{},[1938,11699,1950],{},[1561,11701,1943],{},[1565,11703,4432],{},[1565,11705,1567],{},[1561,11707,10584],{},[1565,11709,9539],{},[1561,11711,7783],{},[1565,11713,1567],{},[1561,11715,7791],{},[1565,11717,1674],{"separator":1577},[1561,11719,1677],{},[1569,11721,11722],{"encoding":1571},"\\hat{y_1} = 2000 * 50 = 100,000",[383,11724,11726,11820,11838,11856],{"className":11725,"ariaHidden":1577},[1576],[383,11727,11729,11732,11811,11814,11817],{"className":11728},[1581],[383,11730],{"className":11731,"style":2534},[1585],[383,11733,11735],{"className":11734},[1590,4570],[383,11736,11738,11803],{"className":11737},[2041,2042],[383,11739,11741,11800],{"className":11740},[2046],[383,11742,11744,11789],{"className":11743,"style":5334},[2050],[383,11745,11746,11749],{"style":4583},[383,11747],{"className":11748,"style":4587},[2058],[383,11750,11752,11755],{"className":11751},[1590],[383,11753,1950],{"className":11754,"style":2096},[1590,2033],[383,11756,11758],{"className":11757},[2037],[383,11759,11761,11781],{"className":11760},[2041,2042],[383,11762,11764,11778],{"className":11763},[2046],[383,11765,11767],{"className":11766,"style":2051},[2050],[383,11768,11769,11772],{"style":2111},[383,11770],{"className":11771,"style":2059},[2058],[383,11773,11775],{"className":11774},[2063,2064,2065,2066],[383,11776,1943],{"className":11777},[1590,2066],[383,11779,2074],{"className":11780},[2073],[383,11782,11784],{"className":11783},[2046],[383,11785,11787],{"className":11786,"style":2081},[2050],[383,11788],{},[383,11790,11791,11794],{"style":4583},[383,11792],{"className":11793,"style":4587},[2058],[383,11795,11797],{"className":11796,"style":4638},[4637],[383,11798,4432],{"className":11799},[1590],[383,11801,2074],{"className":11802},[2073],[383,11804,11806],{"className":11805},[2046],[383,11807,11809],{"className":11808,"style":4651},[2050],[383,11810],{},[383,11812],{"className":11813,"style":1595},[1594],[383,11815,1567],{"className":11816},[1599],[383,11818],{"className":11819,"style":1595},[1594],[383,11821,11823,11826,11829,11832,11835],{"className":11822},[1581],[383,11824],{"className":11825,"style":1586},[1585],[383,11827,10584],{"className":11828},[1590],[383,11830],{"className":11831,"style":2577},[1594],[383,11833,9539],{"className":11834},[3048],[383,11836],{"className":11837,"style":2577},[1594],[383,11839,11841,11844,11847,11850,11853],{"className":11840},[1581],[383,11842],{"className":11843,"style":1586},[1585],[383,11845,7783],{"className":11846},[1590],[383,11848],{"className":11849,"style":1595},[1594],[383,11851,1567],{"className":11852},[1599],[383,11854],{"className":11855,"style":1595},[1594],[383,11857,11859,11862,11865,11868,11871],{"className":11858},[1581],[383,11860],{"className":11861,"style":1693},[1585],[383,11863,7791],{"className":11864},[1590],[383,11866,1674],{"className":11867},[1700],[383,11869],{"className":11870,"style":1704},[1594],[383,11872,1677],{"className":11873},[1590],[37,11875,11876,11877],{},"For 100 m²: ",[383,11878,11880,11919],{"className":11879},[1545],[383,11881,11883],{"className":11882},[1549],[1551,11884,11885],{"xmlns":1553},[1555,11886,11887,11916],{},[1558,11888,11889,11899,11901,11903,11905,11907,11909,11912,11914],{},[4422,11890,11891,11897],{"accent":1577},[1935,11892,11893,11895],{},[1938,11894,1950],{},[1561,11896,1563],{},[1565,11898,4432],{},[1565,11900,1567],{},[1561,11902,10584],{},[1565,11904,9539],{},[1561,11906,7791],{},[1565,11908,1567],{},[1561,11910,11911],{},"200",[1565,11913,1674],{"separator":1577},[1561,11915,1677],{},[1569,11917,11918],{"encoding":1571},"\\hat{y_2} = 2000 * 100 = 200,000",[383,11920,11922,12016,12034,12052],{"className":11921,"ariaHidden":1577},[1576],[383,11923,11925,11928,12007,12010,12013],{"className":11924},[1581],[383,11926],{"className":11927,"style":2534},[1585],[383,11929,11931],{"className":11930},[1590,4570],[383,11932,11934,11999],{"className":11933},[2041,2042],[383,11935,11937,11996],{"className":11936},[2046],[383,11938,11940,11985],{"className":11939,"style":5334},[2050],[383,11941,11942,11945],{"style":4583},[383,11943],{"className":11944,"style":4587},[2058],[383,11946,11948,11951],{"className":11947},[1590],[383,11949,1950],{"className":11950,"style":2096},[1590,2033],[383,11952,11954],{"className":11953},[2037],[383,11955,11957,11977],{"className":11956},[2041,2042],[383,11958,11960,11974],{"className":11959},[2046],[383,11961,11963],{"className":11962,"style":2051},[2050],[383,11964,11965,11968],{"style":2111},[383,11966],{"className":11967,"style":2059},[2058],[383,11969,11971],{"className":11970},[2063,2064,2065,2066],[383,11972,1563],{"className":11973},[1590,2066],[383,11975,2074],{"className":11976},[2073],[383,11978,11980],{"className":11979},[2046],[383,11981,11983],{"className":11982,"style":2081},[2050],[383,11984],{},[383,11986,11987,11990],{"style":4583},[383,11988],{"className":11989,"style":4587},[2058],[383,11991,11993],{"className":11992,"style":4638},[4637],[383,11994,4432],{"className":11995},[1590],[383,11997,2074],{"className":11998},[2073],[383,12000,12002],{"className":12001},[2046],[383,12003,12005],{"className":12004,"style":4651},[2050],[383,12006],{},[383,12008],{"className":12009,"style":1595},[1594],[383,12011,1567],{"className":12012},[1599],[383,12014],{"className":12015,"style":1595},[1594],[383,12017,12019,12022,12025,12028,12031],{"className":12018},[1581],[383,12020],{"className":12021,"style":1586},[1585],[383,12023,10584],{"className":12024},[1590],[383,12026],{"className":12027,"style":2577},[1594],[383,12029,9539],{"className":12030},[3048],[383,12032],{"className":12033,"style":2577},[1594],[383,12035,12037,12040,12043,12046,12049],{"className":12036},[1581],[383,12038],{"className":12039,"style":1586},[1585],[383,12041,7791],{"className":12042},[1590],[383,12044],{"className":12045,"style":1595},[1594],[383,12047,1567],{"className":12048},[1599],[383,12050],{"className":12051,"style":1595},[1594],[383,12053,12055,12058,12061,12064,12067],{"className":12054},[1581],[383,12056],{"className":12057,"style":1693},[1585],[383,12059,11911],{"className":12060},[1590],[383,12062,1674],{"className":12063},[1700],[383,12065],{"className":12066,"style":1704},[1594],[383,12068,1677],{"className":12069},[1590],[37,12071,12072,12073],{},"For 150 m²: ",[383,12074,12076,12115],{"className":12075},[1545],[383,12077,12079],{"className":12078},[1549],[1551,12080,12081],{"xmlns":1553},[1555,12082,12083,12112],{},[1558,12084,12085,12095,12097,12099,12101,12103,12105,12108,12110],{},[4422,12086,12087,12093],{"accent":1577},[1935,12088,12089,12091],{},[1938,12090,1950],{},[1561,12092,9532],{},[1565,12094,4432],{},[1565,12096,1567],{},[1561,12098,10584],{},[1565,12100,9539],{},[1561,12102,7799],{},[1565,12104,1567],{},[1561,12106,12107],{},"300",[1565,12109,1674],{"separator":1577},[1561,12111,1677],{},[1569,12113,12114],{"encoding":1571},"\\hat{y_3} = 2000 * 150 = 300,000",[383,12116,12118,12212,12230,12248],{"className":12117,"ariaHidden":1577},[1576],[383,12119,12121,12124,12203,12206,12209],{"className":12120},[1581],[383,12122],{"className":12123,"style":2534},[1585],[383,12125,12127],{"className":12126},[1590,4570],[383,12128,12130,12195],{"className":12129},[2041,2042],[383,12131,12133,12192],{"className":12132},[2046],[383,12134,12136,12181],{"className":12135,"style":5334},[2050],[383,12137,12138,12141],{"style":4583},[383,12139],{"className":12140,"style":4587},[2058],[383,12142,12144,12147],{"className":12143},[1590],[383,12145,1950],{"className":12146,"style":2096},[1590,2033],[383,12148,12150],{"className":12149},[2037],[383,12151,12153,12173],{"className":12152},[2041,2042],[383,12154,12156,12170],{"className":12155},[2046],[383,12157,12159],{"className":12158,"style":2051},[2050],[383,12160,12161,12164],{"style":2111},[383,12162],{"className":12163,"style":2059},[2058],[383,12165,12167],{"className":12166},[2063,2064,2065,2066],[383,12168,9532],{"className":12169},[1590,2066],[383,12171,2074],{"className":12172},[2073],[383,12174,12176],{"className":12175},[2046],[383,12177,12179],{"className":12178,"style":2081},[2050],[383,12180],{},[383,12182,12183,12186],{"style":4583},[383,12184],{"className":12185,"style":4587},[2058],[383,12187,12189],{"className":12188,"style":4638},[4637],[383,12190,4432],{"className":12191},[1590],[383,12193,2074],{"className":12194},[2073],[383,12196,12198],{"className":12197},[2046],[383,12199,12201],{"className":12200,"style":4651},[2050],[383,12202],{},[383,12204],{"className":12205,"style":1595},[1594],[383,12207,1567],{"className":12208},[1599],[383,12210],{"className":12211,"style":1595},[1594],[383,12213,12215,12218,12221,12224,12227],{"className":12214},[1581],[383,12216],{"className":12217,"style":1586},[1585],[383,12219,10584],{"className":12220},[1590],[383,12222],{"className":12223,"style":2577},[1594],[383,12225,9539],{"className":12226},[3048],[383,12228],{"className":12229,"style":2577},[1594],[383,12231,12233,12236,12239,12242,12245],{"className":12232},[1581],[383,12234],{"className":12235,"style":1586},[1585],[383,12237,7799],{"className":12238},[1590],[383,12240],{"className":12241,"style":1595},[1594],[383,12243,1567],{"className":12244},[1599],[383,12246],{"className":12247,"style":1595},[1594],[383,12249,12251,12254,12257,12260,12263],{"className":12250},[1581],[383,12252],{"className":12253,"style":1693},[1585],[383,12255,12107],{"className":12256},[1590],[383,12258,1674],{"className":12259},[1700],[383,12261],{"className":12262,"style":1704},[1594],[383,12264,1677],{"className":12265},[1590],[1008,12267,12268],{"start":1823},[37,12269,12270],{},"We calculate the errors for each example:",[383,12272,12274],{"className":12273},[2494],[383,12275,12277,12316],{"className":12276},[1545],[383,12278,12280],{"className":12279},[1549],[1551,12281,12282],{"xmlns":1553,"display":2503},[1555,12283,12284,12313],{},[1558,12285,12286,12293,12295,12301,12303],{},[1935,12287,12288,12291],{},[1938,12289,12290],{},"e",[1938,12292,2363],{},[1565,12294,1567],{},[1935,12296,12297,12299],{},[1938,12298,1950],{},[1938,12300,2363],{},[1565,12302,1680],{},[4422,12304,12305,12311],{"accent":1577},[1935,12306,12307,12309],{},[1938,12308,1950],{},[1938,12310,2363],{},[1565,12312,4432],{},[1569,12314,12315],{"encoding":1571},"e_i = y_i - \\hat{y_i}",[383,12317,12319,12374,12429],{"className":12318,"ariaHidden":1577},[1576],[383,12320,12322,12325,12365,12368,12371],{"className":12321},[1581],[383,12323],{"className":12324,"style":2376},[1585],[383,12326,12328,12331],{"className":12327},[1590],[383,12329,12290],{"className":12330},[1590,2033],[383,12332,12334],{"className":12333},[2037],[383,12335,12337,12357],{"className":12336},[2041,2042],[383,12338,12340,12354],{"className":12339},[2046],[383,12341,12343],{"className":12342,"style":2395},[2050],[383,12344,12345,12348],{"style":2054},[383,12346],{"className":12347,"style":2059},[2058],[383,12349,12351],{"className":12350},[2063,2064,2065,2066],[383,12352,2363],{"className":12353},[1590,2033,2066],[383,12355,2074],{"className":12356},[2073],[383,12358,12360],{"className":12359},[2046],[383,12361,12363],{"className":12362,"style":2081},[2050],[383,12364],{},[383,12366],{"className":12367,"style":1595},[1594],[383,12369,1567],{"className":12370},[1599],[383,12372],{"className":12373,"style":1595},[1594],[383,12375,12377,12380,12420,12423,12426],{"className":12376},[1581],[383,12378],{"className":12379,"style":4508},[1585],[383,12381,12383,12386],{"className":12382},[1590],[383,12384,1950],{"className":12385,"style":2096},[1590,2033],[383,12387,12389],{"className":12388},[2037],[383,12390,12392,12412],{"className":12391},[2041,2042],[383,12393,12395,12409],{"className":12394},[2046],[383,12396,12398],{"className":12397,"style":2395},[2050],[383,12399,12400,12403],{"style":2111},[383,12401],{"className":12402,"style":2059},[2058],[383,12404,12406],{"className":12405},[2063,2064,2065,2066],[383,12407,2363],{"className":12408},[1590,2033,2066],[383,12410,2074],{"className":12411},[2073],[383,12413,12415],{"className":12414},[2046],[383,12416,12418],{"className":12417,"style":2081},[2050],[383,12419],{},[383,12421],{"className":12422,"style":2577},[1594],[383,12424,1680],{"className":12425},[3048],[383,12427],{"className":12428,"style":2577},[1594],[383,12430,12432,12435],{"className":12431},[1581],[383,12433],{"className":12434,"style":2534},[1585],[383,12436,12438],{"className":12437},[1590,4570],[383,12439,12441,12506],{"className":12440},[2041,2042],[383,12442,12444,12503],{"className":12443},[2046],[383,12445,12447,12492],{"className":12446,"style":5334},[2050],[383,12448,12449,12452],{"style":4583},[383,12450],{"className":12451,"style":4587},[2058],[383,12453,12455,12458],{"className":12454},[1590],[383,12456,1950],{"className":12457,"style":2096},[1590,2033],[383,12459,12461],{"className":12460},[2037],[383,12462,12464,12484],{"className":12463},[2041,2042],[383,12465,12467,12481],{"className":12466},[2046],[383,12468,12470],{"className":12469,"style":2395},[2050],[383,12471,12472,12475],{"style":2111},[383,12473],{"className":12474,"style":2059},[2058],[383,12476,12478],{"className":12477},[2063,2064,2065,2066],[383,12479,2363],{"className":12480},[1590,2033,2066],[383,12482,2074],{"className":12483},[2073],[383,12485,12487],{"className":12486},[2046],[383,12488,12490],{"className":12489,"style":2081},[2050],[383,12491],{},[383,12493,12494,12497],{"style":4583},[383,12495],{"className":12496,"style":4587},[2058],[383,12498,12500],{"className":12499,"style":4638},[4637],[383,12501,4432],{"className":12502},[1590],[383,12504,2074],{"className":12505},[2073],[383,12507,12509],{"className":12508},[2046],[383,12510,12512],{"className":12511,"style":4651},[2050],[383,12513],{},[34,12515,12516,12655,12794],{},[37,12517,12518,12519],{},"Error for 50 m²: ",[383,12520,12522,12552],{"className":12521},[1545],[383,12523,12525],{"className":12524},[1549],[1551,12526,12527],{"xmlns":1553},[1555,12528,12529,12549],{},[1558,12530,12531,12537,12539,12541,12543,12545,12547],{},[1935,12532,12533,12535],{},[1938,12534,12290],{},[1561,12536,1943],{},[1565,12538,1567],{},[1561,12540,9542],{},[1565,12542,1680],{},[1561,12544,9542],{},[1565,12546,1567],{},[1561,12548,2913],{},[1569,12550,12551],{"encoding":1571},"e_1 = 100000 - 100000 = 0",[383,12553,12555,12610,12628,12646],{"className":12554,"ariaHidden":1577},[1576],[383,12556,12558,12561,12601,12604,12607],{"className":12557},[1581],[383,12559],{"className":12560,"style":2376},[1585],[383,12562,12564,12567],{"className":12563},[1590],[383,12565,12290],{"className":12566},[1590,2033],[383,12568,12570],{"className":12569},[2037],[383,12571,12573,12593],{"className":12572},[2041,2042],[383,12574,12576,12590],{"className":12575},[2046],[383,12577,12579],{"className":12578,"style":2051},[2050],[383,12580,12581,12584],{"style":2054},[383,12582],{"className":12583,"style":2059},[2058],[383,12585,12587],{"className":12586},[2063,2064,2065,2066],[383,12588,1943],{"className":12589},[1590,2066],[383,12591,2074],{"className":12592},[2073],[383,12594,12596],{"className":12595},[2046],[383,12597,12599],{"className":12598,"style":2081},[2050],[383,12600],{},[383,12602],{"className":12603,"style":1595},[1594],[383,12605,1567],{"className":12606},[1599],[383,12608],{"className":12609,"style":1595},[1594],[383,12611,12613,12616,12619,12622,12625],{"className":12612},[1581],[383,12614],{"className":12615,"style":10756},[1585],[383,12617,9542],{"className":12618},[1590],[383,12620],{"className":12621,"style":2577},[1594],[383,12623,1680],{"className":12624},[3048],[383,12626],{"className":12627,"style":2577},[1594],[383,12629,12631,12634,12637,12640,12643],{"className":12630},[1581],[383,12632],{"className":12633,"style":1586},[1585],[383,12635,9542],{"className":12636},[1590],[383,12638],{"className":12639,"style":1595},[1594],[383,12641,1567],{"className":12642},[1599],[383,12644],{"className":12645,"style":1595},[1594],[383,12647,12649,12652],{"className":12648},[1581],[383,12650],{"className":12651,"style":1586},[1585],[383,12653,2913],{"className":12654},[1590],[37,12656,12657,12658],{},"Error for 100 m²: ",[383,12659,12661,12691],{"className":12660},[1545],[383,12662,12664],{"className":12663},[1549],[1551,12665,12666],{"xmlns":1553},[1555,12667,12668,12688],{},[1558,12669,12670,12676,12678,12680,12682,12684,12686],{},[1935,12671,12672,12674],{},[1938,12673,12290],{},[1561,12675,1563],{},[1565,12677,1567],{},[1561,12679,9551],{},[1565,12681,1680],{},[1561,12683,9551],{},[1565,12685,1567],{},[1561,12687,2913],{},[1569,12689,12690],{"encoding":1571},"e_2 = 200000 - 200000 = 0",[383,12692,12694,12749,12767,12785],{"className":12693,"ariaHidden":1577},[1576],[383,12695,12697,12700,12740,12743,12746],{"className":12696},[1581],[383,12698],{"className":12699,"style":2376},[1585],[383,12701,12703,12706],{"className":12702},[1590],[383,12704,12290],{"className":12705},[1590,2033],[383,12707,12709],{"className":12708},[2037],[383,12710,12712,12732],{"className":12711},[2041,2042],[383,12713,12715,12729],{"className":12714},[2046],[383,12716,12718],{"className":12717,"style":2051},[2050],[383,12719,12720,12723],{"style":2054},[383,12721],{"className":12722,"style":2059},[2058],[383,12724,12726],{"className":12725},[2063,2064,2065,2066],[383,12727,1563],{"className":12728},[1590,2066],[383,12730,2074],{"className":12731},[2073],[383,12733,12735],{"className":12734},[2046],[383,12736,12738],{"className":12737,"style":2081},[2050],[383,12739],{},[383,12741],{"className":12742,"style":1595},[1594],[383,12744,1567],{"className":12745},[1599],[383,12747],{"className":12748,"style":1595},[1594],[383,12750,12752,12755,12758,12761,12764],{"className":12751},[1581],[383,12753],{"className":12754,"style":10756},[1585],[383,12756,9551],{"className":12757},[1590],[383,12759],{"className":12760,"style":2577},[1594],[383,12762,1680],{"className":12763},[3048],[383,12765],{"className":12766,"style":2577},[1594],[383,12768,12770,12773,12776,12779,12782],{"className":12769},[1581],[383,12771],{"className":12772,"style":1586},[1585],[383,12774,9551],{"className":12775},[1590],[383,12777],{"className":12778,"style":1595},[1594],[383,12780,1567],{"className":12781},[1599],[383,12783],{"className":12784,"style":1595},[1594],[383,12786,12788,12791],{"className":12787},[1581],[383,12789],{"className":12790,"style":1586},[1585],[383,12792,2913],{"className":12793},[1590],[37,12795,12796,12797],{},"Error for 150 m²: ",[383,12798,12800,12830],{"className":12799},[1545],[383,12801,12803],{"className":12802},[1549],[1551,12804,12805],{"xmlns":1553},[1555,12806,12807,12827],{},[1558,12808,12809,12815,12817,12819,12821,12823,12825],{},[1935,12810,12811,12813],{},[1938,12812,12290],{},[1561,12814,9532],{},[1565,12816,1567],{},[1561,12818,9560],{},[1565,12820,1680],{},[1561,12822,9560],{},[1565,12824,1567],{},[1561,12826,2913],{},[1569,12828,12829],{"encoding":1571},"e_3 = 300000 - 300000 = 0",[383,12831,12833,12888,12906,12924],{"className":12832,"ariaHidden":1577},[1576],[383,12834,12836,12839,12879,12882,12885],{"className":12835},[1581],[383,12837],{"className":12838,"style":2376},[1585],[383,12840,12842,12845],{"className":12841},[1590],[383,12843,12290],{"className":12844},[1590,2033],[383,12846,12848],{"className":12847},[2037],[383,12849,12851,12871],{"className":12850},[2041,2042],[383,12852,12854,12868],{"className":12853},[2046],[383,12855,12857],{"className":12856,"style":2051},[2050],[383,12858,12859,12862],{"style":2054},[383,12860],{"className":12861,"style":2059},[2058],[383,12863,12865],{"className":12864},[2063,2064,2065,2066],[383,12866,9532],{"className":12867},[1590,2066],[383,12869,2074],{"className":12870},[2073],[383,12872,12874],{"className":12873},[2046],[383,12875,12877],{"className":12876,"style":2081},[2050],[383,12878],{},[383,12880],{"className":12881,"style":1595},[1594],[383,12883,1567],{"className":12884},[1599],[383,12886],{"className":12887,"style":1595},[1594],[383,12889,12891,12894,12897,12900,12903],{"className":12890},[1581],[383,12892],{"className":12893,"style":10756},[1585],[383,12895,9560],{"className":12896},[1590],[383,12898],{"className":12899,"style":2577},[1594],[383,12901,1680],{"className":12902},[3048],[383,12904],{"className":12905,"style":2577},[1594],[383,12907,12909,12912,12915,12918,12921],{"className":12908},[1581],[383,12910],{"className":12911,"style":1586},[1585],[383,12913,9560],{"className":12914},[1590],[383,12916],{"className":12917,"style":1595},[1594],[383,12919,1567],{"className":12920},[1599],[383,12922],{"className":12923,"style":1595},[1594],[383,12925,12927,12930],{"className":12926},[1581],[383,12928],{"className":12929,"style":1586},[1585],[383,12931,2913],{"className":12932},[1590],[1008,12934,12935],{"start":1820},[37,12936,12937],{},"We square the errors and average them to obtain the MSE:",[383,12939,12941],{"className":12940},[2494],[383,12942,12944,13000],{"className":12943},[1545],[383,12945,12947],{"className":12946},[1549],[1551,12948,12949],{"xmlns":1553,"display":2503},[1555,12950,12951,12997],{},[1558,12952,12953,12955,12957,12959,12961,12967,12969,12975,12977,12983,12985,12991,12993,12995],{},[1938,12954,5015],{},[1938,12956,5018],{},[1938,12958,5021],{},[1565,12960,1567],{},[5025,12962,12963,12965],{},[1561,12964,1943],{},[1561,12966,9532],{},[1565,12968,1933],{"stretchy":1929},[5068,12970,12971,12973],{},[1561,12972,2913],{},[1561,12974,1563],{},[1565,12976,2916],{},[5068,12978,12979,12981],{},[1561,12980,2913],{},[1561,12982,1563],{},[1565,12984,2916],{},[5068,12986,12987,12989],{},[1561,12988,2913],{},[1561,12990,1563],{},[1565,12992,1955],{"stretchy":1929},[1565,12994,1567],{},[1561,12996,2913],{},[1569,12998,12999],{"encoding":1571},"MSE = \\frac{1}{3} (0^2 + 0^2 + 0^2) = 0",[383,13001,13003,13027,13136,13181,13228],{"className":13002,"ariaHidden":1577},[1576],[383,13004,13006,13009,13012,13015,13018,13021,13024],{"className":13005},[1581],[383,13007],{"className":13008,"style":2554},[1585],[383,13010,5015],{"className":13011,"style":5089},[1590,2033],[383,13013,5018],{"className":13014,"style":5093},[1590,2033],[383,13016,5021],{"className":13017,"style":5093},[1590,2033],[383,13019],{"className":13020,"style":1595},[1594],[383,13022,1567],{"className":13023},[1599],[383,13025],{"className":13026,"style":1595},[1594],[383,13028,13030,13033,13095,13098,13127,13130,13133],{"className":13029},[1581],[383,13031],{"className":13032,"style":10239},[1585],[383,13034,13036,13039,13092],{"className":13035},[1590],[383,13037],{"className":13038},[2025,5119],[383,13040,13042],{"className":13041},[5025],[383,13043,13045,13084],{"className":13044},[2041,2042],[383,13046,13048,13081],{"className":13047},[2046],[383,13049,13051,13062,13070],{"className":13050,"style":5132},[2050],[383,13052,13053,13056],{"style":5135},[383,13054],{"className":13055,"style":4587},[2058],[383,13057,13059],{"className":13058},[1590],[383,13060,9532],{"className":13061},[1590],[383,13063,13064,13067],{"style":5147},[383,13065],{"className":13066,"style":4587},[2058],[383,13068],{"className":13069,"style":5155},[5154],[383,13071,13072,13075],{"style":5158},[383,13073],{"className":13074,"style":4587},[2058],[383,13076,13078],{"className":13077},[1590],[383,13079,1943],{"className":13080},[1590],[383,13082,2074],{"className":13083},[2073],[383,13085,13087],{"className":13086},[2046],[383,13088,13090],{"className":13089,"style":5177},[2050],[383,13091],{},[383,13093],{"className":13094},[2135,5119],[383,13096,1933],{"className":13097},[2025],[383,13099,13101,13104],{"className":13100},[1590],[383,13102,2913],{"className":13103},[1590],[383,13105,13107],{"className":13106},[2037],[383,13108,13110],{"className":13109},[2041],[383,13111,13113],{"className":13112},[2046],[383,13114,13116],{"className":13115,"style":5420},[2050],[383,13117,13118,13121],{"style":5423},[383,13119],{"className":13120,"style":2059},[2058],[383,13122,13124],{"className":13123},[2063,2064,2065,2066],[383,13125,1563],{"className":13126},[1590,2066],[383,13128],{"className":13129,"style":2577},[1594],[383,13131,2916],{"className":13132},[3048],[383,13134],{"className":13135,"style":2577},[1594],[383,13137,13139,13143,13172,13175,13178],{"className":13138},[1581],[383,13140],{"className":13141,"style":13142},[1585],"height:0.9474em;vertical-align:-0.0833em;",[383,13144,13146,13149],{"className":13145},[1590],[383,13147,2913],{"className":13148},[1590],[383,13150,13152],{"className":13151},[2037],[383,13153,13155],{"className":13154},[2041],[383,13156,13158],{"className":13157},[2046],[383,13159,13161],{"className":13160,"style":5420},[2050],[383,13162,13163,13166],{"style":5423},[383,13164],{"className":13165,"style":2059},[2058],[383,13167,13169],{"className":13168},[2063,2064,2065,2066],[383,13170,1563],{"className":13171},[1590,2066],[383,13173],{"className":13174,"style":2577},[1594],[383,13176,2916],{"className":13177},[3048],[383,13179],{"className":13180,"style":2577},[1594],[383,13182,13184,13187,13216,13219,13222,13225],{"className":13183},[1581],[383,13185],{"className":13186,"style":5321},[1585],[383,13188,13190,13193],{"className":13189},[1590],[383,13191,2913],{"className":13192},[1590],[383,13194,13196],{"className":13195},[2037],[383,13197,13199],{"className":13198},[2041],[383,13200,13202],{"className":13201},[2046],[383,13203,13205],{"className":13204,"style":5420},[2050],[383,13206,13207,13210],{"style":5423},[383,13208],{"className":13209,"style":2059},[2058],[383,13211,13213],{"className":13212},[2063,2064,2065,2066],[383,13214,1563],{"className":13215},[1590,2066],[383,13217,1955],{"className":13218},[2135],[383,13220],{"className":13221,"style":1595},[1594],[383,13223,1567],{"className":13224},[1599],[383,13226],{"className":13227,"style":1595},[1594],[383,13229,13231,13234],{"className":13230},[1581],[383,13232],{"className":13233,"style":1586},[1585],[383,13235,2913],{"className":13236},[1590],[11,13238,13239,13240,13243,13244,13272],{},"For this case, an MSE of 0 indicates that the model predicts the real values perfectly for ",[40,13241,13242],{},"this training dataset",". Of course, in practice, real data will contain noise and will be even more variable, so the epsilon ",[383,13245,13247,13260],{"className":13246},[1545],[383,13248,13250],{"className":13249},[1549],[1551,13251,13252],{"xmlns":1553},[1555,13253,13254,13258],{},[1558,13255,13256],{},[1938,13257,2969],{},[1569,13259,3950],{"encoding":1571},[383,13261,13263],{"className":13262,"ariaHidden":1577},[1576],[383,13264,13266,13269],{"className":13265},[1581],[383,13267],{"className":13268,"style":3364},[1585],[383,13270,2969],{"className":13271},[1590,2033]," will not be zero.",[11,13274,13275,13276],{},"To explore more with regression, you can use this Google Colab that contains a complete example of linear regression with Python: ",[18,13277,13283],{"href":13278,"target":13279,"rel":13280},"https:\u002F\u002Fcolab.research.google.com\u002Fdrive\u002F1yi8-fVw2Ak7pqYOzZsiT7NO_zccZrQir?usp=sharing","_blank",[13281,13282],"noopener","noreferrer","linear_regression",[28,13285],{},[299,13287,2587],{"id":13288},"classification",[11,13290,13291],{},"A classification problem aims to predict a categorical output variable based on a set of input variables. For example, predicting whether an email is spam or not spam based on its content, or determining whether an image contains a cat or a dog.",[11,13293,13294],{},"There are three main types of classification:",[34,13296,13297,13303,13309],{},[37,13298,13299,13302],{},[40,13300,13301],{},"Binary Classification",": When there are two possible classes. For example, classifying whether a patient has a disease (yes\u002Fno).",[37,13304,13305,13308],{},[40,13306,13307],{},"Multi-class Classification",": When there are more than two possible classes. For example, classifying the type of flower (could be setosa, versicolor or virginica) based on its characteristics.",[37,13310,13311,13314],{},[40,13312,13313],{},"Multi-label Classification",": When each example can belong to multiple classes, such as classifying the labels of a news article (politics, economy, sports) where an article can belong to several categories.",[293,13316,13317],{},[11,13318,13319],{},"The difference between multi-class and multi-label classification is that in the former each example can only belong to one class, while in the latter an example can belong to multiple classes simultaneously.",[11,13321,13322],{},"Let's look a bit more at binary classification. In this case, the objective is to find a function that maps the inputs to one of the two possible classes.",[11,13324,13325,13326,13329,13330,13444],{},"The question that the binary classification model attempts to answer is: ",[40,13327,13328],{},"What is the probability that an example belongs to class 1 given a set of features?"," This can be expressed mathematically as:\n",[383,13331,13333,13373],{"className":13332},[1545],[383,13334,13336],{"className":13335},[1549],[1551,13337,13338],{"xmlns":1553},[1555,13339,13340,13370],{},[1558,13341,13342,13345,13347,13349,13351,13353,13356,13358,13360,13362,13364,13366,13368],{},[1938,13343,13344],{},"P",[1565,13346,1933],{"stretchy":1929},[1938,13348,1950],{},[1565,13350,1567],{},[1561,13352,1943],{},[1938,13354,13355],{"mathvariant":1980},"∣",[1938,13357,1940],{},[1565,13359,1955],{"stretchy":1929},[1565,13361,1567],{},[1938,13363,2510],{},[1565,13365,1933],{"stretchy":1929},[1938,13367,1940],{},[1565,13369,1955],{"stretchy":1929},[1569,13371,13372],{"encoding":1571},"P(y=1|x) = f(x)",[383,13374,13376,13401,13426],{"className":13375,"ariaHidden":1577},[1576],[383,13377,13379,13382,13386,13389,13392,13395,13398],{"className":13378},[1581],[383,13380],{"className":13381,"style":2021},[1585],[383,13383,13344],{"className":13384,"style":13385},[1590,2033],"margin-right:0.1389em;",[383,13387,1933],{"className":13388},[2025],[383,13390,1950],{"className":13391,"style":2096},[1590,2033],[383,13393],{"className":13394,"style":1595},[1594],[383,13396,1567],{"className":13397},[1599],[383,13399],{"className":13400,"style":1595},[1594],[383,13402,13404,13407,13411,13414,13417,13420,13423],{"className":13403},[1581],[383,13405],{"className":13406,"style":2021},[1585],[383,13408,13410],{"className":13409},[1590],"1∣",[383,13412,1940],{"className":13413},[1590,2033],[383,13415,1955],{"className":13416},[2135],[383,13418],{"className":13419,"style":1595},[1594],[383,13421,1567],{"className":13422},[1599],[383,13424],{"className":13425,"style":1595},[1594],[383,13427,13429,13432,13435,13438,13441],{"className":13428},[1581],[383,13430],{"className":13431,"style":2021},[1585],[383,13433,2510],{"className":13434,"style":2538},[1590,2033],[383,13436,1933],{"className":13437},[2025],[383,13439,1940],{"className":13440},[1590,2033],[383,13442,1955],{"className":13443},[2135],"\nWhere:",[34,13446,13447,13523],{},[37,13448,13449,13522],{},[383,13450,13452,13480],{"className":13451},[1545],[383,13453,13455],{"className":13454},[1549],[1551,13456,13457],{"xmlns":1553},[1555,13458,13459,13477],{},[1558,13460,13461,13463,13465,13467,13469,13471,13473,13475],{},[1938,13462,13344],{},[1565,13464,1933],{"stretchy":1929},[1938,13466,1950],{},[1565,13468,1567],{},[1561,13470,1943],{},[1938,13472,13355],{"mathvariant":1980},[1938,13474,1940],{},[1565,13476,1955],{"stretchy":1929},[1569,13478,13479],{"encoding":1571},"P(y=1|x)",[383,13481,13483,13507],{"className":13482,"ariaHidden":1577},[1576],[383,13484,13486,13489,13492,13495,13498,13501,13504],{"className":13485},[1581],[383,13487],{"className":13488,"style":2021},[1585],[383,13490,13344],{"className":13491,"style":13385},[1590,2033],[383,13493,1933],{"className":13494},[2025],[383,13496,1950],{"className":13497,"style":2096},[1590,2033],[383,13499],{"className":13500,"style":1595},[1594],[383,13502,1567],{"className":13503},[1599],[383,13505],{"className":13506,"style":1595},[1594],[383,13508,13510,13513,13516,13519],{"className":13509},[1581],[383,13511],{"className":13512,"style":2021},[1585],[383,13514,13410],{"className":13515},[1590],[383,13517,1940],{"className":13518},[1590,2033],[383,13520,1955],{"className":13521},[2135]," is the probability that the class is 1 given the feature vector x.",[37,13524,13525,13569],{},[383,13526,13528,13548],{"className":13527},[1545],[383,13529,13531],{"className":13530},[1549],[1551,13532,13533],{"xmlns":1553},[1555,13534,13535,13545],{},[1558,13536,13537,13539,13541,13543],{},[1938,13538,2510],{},[1565,13540,1933],{"stretchy":1929},[1938,13542,1940],{},[1565,13544,1955],{"stretchy":1929},[1569,13546,13547],{"encoding":1571},"f(x)",[383,13549,13551],{"className":13550,"ariaHidden":1577},[1576],[383,13552,13554,13557,13560,13563,13566],{"className":13553},[1581],[383,13555],{"className":13556,"style":2021},[1585],[383,13558,2510],{"className":13559,"style":2538},[1590,2033],[383,13561,1933],{"className":13562},[2025],[383,13564,1940],{"className":13565},[1590,2033],[383,13567,1955],{"className":13568},[2135]," is the function that maps the features to the probability.",[11,13571,13572,13573,13576],{},"The most common model for binary classification is the ",[40,13574,13575],{},"logistic regression",", which has the following process:",[1008,13578,13579],{},[37,13580,13581,13582,13585],{},"We calculate a ",[40,13583,13584],{},"linear combination"," of the features:",[383,13587,13589],{"className":13588},[2494],[383,13590,13592,13665],{"className":13591},[1545],[383,13593,13595],{"className":13594},[1549],[1551,13596,13597],{"xmlns":1553,"display":2503},[1555,13598,13599,13662],{},[1558,13600,13601,13604,13606,13612,13614,13620,13626,13628,13634,13640,13642,13644,13646,13648,13650,13656],{},[1938,13602,13603],{},"z",[1565,13605,1567],{},[1935,13607,13608,13610],{},[1938,13609,2910],{},[1561,13611,2913],{},[1565,13613,2916],{},[1935,13615,13616,13618],{},[1938,13617,2910],{},[1561,13619,1943],{},[1935,13621,13622,13624],{},[1938,13623,1940],{},[1561,13625,1943],{},[1565,13627,2916],{},[1935,13629,13630,13632],{},[1938,13631,2910],{},[1561,13633,1563],{},[1935,13635,13636,13638],{},[1938,13637,1940],{},[1561,13639,1563],{},[1565,13641,2916],{},[1938,13643,1497],{"mathvariant":1980},[1938,13645,1497],{"mathvariant":1980},[1938,13647,1497],{"mathvariant":1980},[1565,13649,2916],{},[1935,13651,13652,13654],{},[1938,13653,2910],{},[1938,13655,11],{},[1935,13657,13658,13660],{},[1938,13659,1940],{},[1938,13661,11],{},[1569,13663,13664],{"encoding":1571},"z = \\beta_0 + \\beta_1 x_1 + \\beta_2 x_2 + ... + \\beta_p x_p",[383,13666,13668,13687,13742,13837,13932,13950],{"className":13667,"ariaHidden":1577},[1576],[383,13669,13671,13674,13678,13681,13684],{"className":13670},[1581],[383,13672],{"className":13673,"style":3364},[1585],[383,13675,13603],{"className":13676,"style":13677},[1590,2033],"margin-right:0.044em;",[383,13679],{"className":13680,"style":1595},[1594],[383,13682,1567],{"className":13683},[1599],[383,13685],{"className":13686,"style":1595},[1594],[383,13688,13690,13693,13733,13736,13739],{"className":13689},[1581],[383,13691],{"className":13692,"style":2534},[1585],[383,13694,13696,13699],{"className":13695},[1590],[383,13697,2910],{"className":13698,"style":3006},[1590,2033],[383,13700,13702],{"className":13701},[2037],[383,13703,13705,13725],{"className":13704},[2041,2042],[383,13706,13708,13722],{"className":13707},[2046],[383,13709,13711],{"className":13710,"style":2051},[2050],[383,13712,13713,13716],{"style":3021},[383,13714],{"className":13715,"style":2059},[2058],[383,13717,13719],{"className":13718},[2063,2064,2065,2066],[383,13720,2913],{"className":13721},[1590,2066],[383,13723,2074],{"className":13724},[2073],[383,13726,13728],{"className":13727},[2046],[383,13729,13731],{"className":13730,"style":2081},[2050],[383,13732],{},[383,13734],{"className":13735,"style":2577},[1594],[383,13737,2916],{"className":13738},[3048],[383,13740],{"className":13741,"style":2577},[1594],[383,13743,13745,13748,13788,13828,13831,13834],{"className":13744},[1581],[383,13746],{"className":13747,"style":2534},[1585],[383,13749,13751,13754],{"className":13750},[1590],[383,13752,2910],{"className":13753,"style":3006},[1590,2033],[383,13755,13757],{"className":13756},[2037],[383,13758,13760,13780],{"className":13759},[2041,2042],[383,13761,13763,13777],{"className":13762},[2046],[383,13764,13766],{"className":13765,"style":2051},[2050],[383,13767,13768,13771],{"style":3021},[383,13769],{"className":13770,"style":2059},[2058],[383,13772,13774],{"className":13773},[2063,2064,2065,2066],[383,13775,1943],{"className":13776},[1590,2066],[383,13778,2074],{"className":13779},[2073],[383,13781,13783],{"className":13782},[2046],[383,13784,13786],{"className":13785,"style":2081},[2050],[383,13787],{},[383,13789,13791,13794],{"className":13790},[1590],[383,13792,1940],{"className":13793},[1590,2033],[383,13795,13797],{"className":13796},[2037],[383,13798,13800,13820],{"className":13799},[2041,2042],[383,13801,13803,13817],{"className":13802},[2046],[383,13804,13806],{"className":13805,"style":2051},[2050],[383,13807,13808,13811],{"style":2054},[383,13809],{"className":13810,"style":2059},[2058],[383,13812,13814],{"className":13813},[2063,2064,2065,2066],[383,13815,1943],{"className":13816},[1590,2066],[383,13818,2074],{"className":13819},[2073],[383,13821,13823],{"className":13822},[2046],[383,13824,13826],{"className":13825,"style":2081},[2050],[383,13827],{},[383,13829],{"className":13830,"style":2577},[1594],[383,13832,2916],{"className":13833},[3048],[383,13835],{"className":13836,"style":2577},[1594],[383,13838,13840,13843,13883,13923,13926,13929],{"className":13839},[1581],[383,13841],{"className":13842,"style":2534},[1585],[383,13844,13846,13849],{"className":13845},[1590],[383,13847,2910],{"className":13848,"style":3006},[1590,2033],[383,13850,13852],{"className":13851},[2037],[383,13853,13855,13875],{"className":13854},[2041,2042],[383,13856,13858,13872],{"className":13857},[2046],[383,13859,13861],{"className":13860,"style":2051},[2050],[383,13862,13863,13866],{"style":3021},[383,13864],{"className":13865,"style":2059},[2058],[383,13867,13869],{"className":13868},[2063,2064,2065,2066],[383,13870,1563],{"className":13871},[1590,2066],[383,13873,2074],{"className":13874},[2073],[383,13876,13878],{"className":13877},[2046],[383,13879,13881],{"className":13880,"style":2081},[2050],[383,13882],{},[383,13884,13886,13889],{"className":13885},[1590],[383,13887,1940],{"className":13888},[1590,2033],[383,13890,13892],{"className":13891},[2037],[383,13893,13895,13915],{"className":13894},[2041,2042],[383,13896,13898,13912],{"className":13897},[2046],[383,13899,13901],{"className":13900,"style":2051},[2050],[383,13902,13903,13906],{"style":2054},[383,13904],{"className":13905,"style":2059},[2058],[383,13907,13909],{"className":13908},[2063,2064,2065,2066],[383,13910,1563],{"className":13911},[1590,2066],[383,13913,2074],{"className":13914},[2073],[383,13916,13918],{"className":13917},[2046],[383,13919,13921],{"className":13920,"style":2081},[2050],[383,13922],{},[383,13924],{"className":13925,"style":2577},[1594],[383,13927,2916],{"className":13928},[3048],[383,13930],{"className":13931,"style":2577},[1594],[383,13933,13935,13938,13941,13944,13947],{"className":13934},[1581],[383,13936],{"className":13937,"style":3248},[1585],[383,13939,2243],{"className":13940},[1590],[383,13942],{"className":13943,"style":2577},[1594],[383,13945,2916],{"className":13946},[3048],[383,13948],{"className":13949,"style":2577},[1594],[383,13951,13953,13956,13996],{"className":13952},[1581],[383,13954],{"className":13955,"style":3267},[1585],[383,13957,13959,13962],{"className":13958},[1590],[383,13960,2910],{"className":13961,"style":3006},[1590,2033],[383,13963,13965],{"className":13964},[2037],[383,13966,13968,13988],{"className":13967},[2041,2042],[383,13969,13971,13985],{"className":13970},[2046],[383,13972,13974],{"className":13973,"style":2271},[2050],[383,13975,13976,13979],{"style":3021},[383,13977],{"className":13978,"style":2059},[2058],[383,13980,13982],{"className":13981},[2063,2064,2065,2066],[383,13983,11],{"className":13984},[1590,2033,2066],[383,13986,2074],{"className":13987},[2073],[383,13989,13991],{"className":13990},[2046],[383,13992,13994],{"className":13993,"style":3306},[2050],[383,13995],{},[383,13997,13999,14002],{"className":13998},[1590],[383,14000,1940],{"className":14001},[1590,2033],[383,14003,14005],{"className":14004},[2037],[383,14006,14008,14028],{"className":14007},[2041,2042],[383,14009,14011,14025],{"className":14010},[2046],[383,14012,14014],{"className":14013,"style":2271},[2050],[383,14015,14016,14019],{"style":2054},[383,14017],{"className":14018,"style":2059},[2058],[383,14020,14022],{"className":14021},[2063,2064,2065,2066],[383,14023,11],{"className":14024},[1590,2033,2066],[383,14026,2074],{"className":14027},[2073],[383,14029,14031],{"className":14030},[2046],[383,14032,14034],{"className":14033,"style":3306},[2050],[383,14035],{},[1008,14037,14038],{"start":1823},[37,14039,14040,14041,14044],{},"We apply the ",[40,14042,14043],{},"sigmoid function"," to obtain a probability:",[383,14046,14048],{"className":14047},[2494],[383,14049,14051,14094],{"className":14050},[1545],[383,14052,14054],{"className":14053},[1549],[1551,14055,14056],{"xmlns":1553,"display":2503},[1555,14057,14058,14091],{},[1558,14059,14060,14063,14065,14067,14069,14071],{},[1938,14061,14062],{},"σ",[1565,14064,1933],{"stretchy":1929},[1938,14066,13603],{},[1565,14068,1955],{"stretchy":1929},[1565,14070,1567],{},[5025,14072,14073,14075],{},[1561,14074,1943],{},[1558,14076,14077,14079,14081],{},[1561,14078,1943],{},[1565,14080,2916],{},[5068,14082,14083,14085],{},[1938,14084,12290],{},[1558,14086,14087,14089],{},[1565,14088,1680],{},[1938,14090,13603],{},[1569,14092,14093],{"encoding":1571},"\\sigma(z) = \\frac{1}{1 + e^{-z}}",[383,14095,14097,14124],{"className":14096,"ariaHidden":1577},[1576],[383,14098,14100,14103,14106,14109,14112,14115,14118,14121],{"className":14099},[1581],[383,14101],{"className":14102,"style":2021},[1585],[383,14104,14062],{"className":14105,"style":2096},[1590,2033],[383,14107,1933],{"className":14108},[2025],[383,14110,13603],{"className":14111,"style":13677},[1590,2033],[383,14113,1955],{"className":14114},[2135],[383,14116],{"className":14117,"style":1595},[1594],[383,14119,1567],{"className":14120},[1599],[383,14122],{"className":14123,"style":1595},[1594],[383,14125,14127,14131],{"className":14126},[1581],[383,14128],{"className":14129,"style":14130},[1585],"height:2.0908em;vertical-align:-0.7693em;",[383,14132,14134,14137,14236],{"className":14133},[1590],[383,14135],{"className":14136},[2025,5119],[383,14138,14140],{"className":14139},[5025],[383,14141,14143,14227],{"className":14142},[2041,2042],[383,14144,14146,14224],{"className":14145},[2046],[383,14147,14149,14205,14213],{"className":14148,"style":5132},[2050],[383,14150,14151,14154],{"style":5135},[383,14152],{"className":14153,"style":4587},[2058],[383,14155,14157,14160,14163,14166,14169],{"className":14156},[1590],[383,14158,1943],{"className":14159},[1590],[383,14161],{"className":14162,"style":2577},[1594],[383,14164,2916],{"className":14165},[3048],[383,14167],{"className":14168,"style":2577},[1594],[383,14170,14172,14175],{"className":14171},[1590],[383,14173,12290],{"className":14174},[1590,2033],[383,14176,14178],{"className":14177},[2037],[383,14179,14181],{"className":14180},[2041],[383,14182,14184],{"className":14183},[2046],[383,14185,14188],{"className":14186,"style":14187},[2050],"height:0.6973em;",[383,14189,14190,14193],{"style":6969},[383,14191],{"className":14192,"style":2059},[2058],[383,14194,14196],{"className":14195},[2063,2064,2065,2066],[383,14197,14199,14202],{"className":14198},[1590,2066],[383,14200,1680],{"className":14201},[1590,2066],[383,14203,13603],{"className":14204,"style":13677},[1590,2033,2066],[383,14206,14207,14210],{"style":5147},[383,14208],{"className":14209,"style":4587},[2058],[383,14211],{"className":14212,"style":5155},[5154],[383,14214,14215,14218],{"style":5158},[383,14216],{"className":14217,"style":4587},[2058],[383,14219,14221],{"className":14220},[1590],[383,14222,1943],{"className":14223},[1590],[383,14225,2074],{"className":14226},[2073],[383,14228,14230],{"className":14229},[2046],[383,14231,14234],{"className":14232,"style":14233},[2050],"height:0.7693em;",[383,14235],{},[383,14237],{"className":14238},[2135,5119],[1008,14240,14241],{"start":1820},[37,14242,14243],{},"Class probability:",[383,14245,14247],{"className":14246},[2494],[383,14248,14250,14368],{"className":14249},[1545],[383,14251,14253],{"className":14252},[1549],[1551,14254,14255],{"xmlns":1553,"display":2503},[1555,14256,14257,14365],{},[1558,14258,14259,14261,14263,14265,14267,14269,14271,14273,14275,14277,14279,14281,14283,14285,14287],{},[1938,14260,13344],{},[1565,14262,1933],{"stretchy":1929},[1938,14264,1950],{},[1565,14266,1567],{},[1561,14268,1943],{},[1938,14270,13355],{"mathvariant":1980},[1938,14272,1940],{},[1565,14274,1955],{"stretchy":1929},[1565,14276,1567],{},[1938,14278,14062],{},[1565,14280,1933],{"stretchy":1929},[1938,14282,13603],{},[1565,14284,1955],{"stretchy":1929},[1565,14286,1567],{},[5025,14288,14289,14291],{},[1561,14290,1943],{},[1558,14292,14293,14295,14297],{},[1561,14294,1943],{},[1565,14296,2916],{},[5068,14298,14299,14301],{},[1938,14300,12290],{},[1558,14302,14303,14305,14307,14313,14315,14321,14327,14329,14335,14341,14343,14345,14347,14349,14351,14357,14363],{},[1565,14304,1680],{},[1565,14306,1933],{"stretchy":1929},[1935,14308,14309,14311],{},[1938,14310,2910],{},[1561,14312,2913],{},[1565,14314,2916],{},[1935,14316,14317,14319],{},[1938,14318,2910],{},[1561,14320,1943],{},[1935,14322,14323,14325],{},[1938,14324,1940],{},[1561,14326,1943],{},[1565,14328,2916],{},[1935,14330,14331,14333],{},[1938,14332,2910],{},[1561,14334,1563],{},[1935,14336,14337,14339],{},[1938,14338,1940],{},[1561,14340,1563],{},[1565,14342,2916],{},[1938,14344,1497],{"mathvariant":1980},[1938,14346,1497],{"mathvariant":1980},[1938,14348,1497],{"mathvariant":1980},[1565,14350,2916],{},[1935,14352,14353,14355],{},[1938,14354,2910],{},[1938,14356,11],{},[1935,14358,14359,14361],{},[1938,14360,1940],{},[1938,14362,11],{},[1565,14364,1955],{"stretchy":1929},[1569,14366,14367],{"encoding":1571},"P(y=1|x) = \\sigma(z) = \\frac{1}{1 + e^{-(\\beta_0 + \\beta_1 x_1 + \\beta_2 x_2 + ... + \\beta_p x_p)}}",[383,14369,14371,14395,14419,14446],{"className":14370,"ariaHidden":1577},[1576],[383,14372,14374,14377,14380,14383,14386,14389,14392],{"className":14373},[1581],[383,14375],{"className":14376,"style":2021},[1585],[383,14378,13344],{"className":14379,"style":13385},[1590,2033],[383,14381,1933],{"className":14382},[2025],[383,14384,1950],{"className":14385,"style":2096},[1590,2033],[383,14387],{"className":14388,"style":1595},[1594],[383,14390,1567],{"className":14391},[1599],[383,14393],{"className":14394,"style":1595},[1594],[383,14396,14398,14401,14404,14407,14410,14413,14416],{"className":14397},[1581],[383,14399],{"className":14400,"style":2021},[1585],[383,14402,13410],{"className":14403},[1590],[383,14405,1940],{"className":14406},[1590,2033],[383,14408,1955],{"className":14409},[2135],[383,14411],{"className":14412,"style":1595},[1594],[383,14414,1567],{"className":14415},[1599],[383,14417],{"className":14418,"style":1595},[1594],[383,14420,14422,14425,14428,14431,14434,14437,14440,14443],{"className":14421},[1581],[383,14423],{"className":14424,"style":2021},[1585],[383,14426,14062],{"className":14427,"style":2096},[1590,2033],[383,14429,1933],{"className":14430},[2025],[383,14432,13603],{"className":14433,"style":13677},[1590,2033],[383,14435,1955],{"className":14436},[2135],[383,14438],{"className":14439,"style":1595},[1594],[383,14441,1567],{"className":14442},[1599],[383,14444],{"className":14445,"style":1595},[1594],[383,14447,14449,14453],{"className":14448},[1581],[383,14450],{"className":14451,"style":14452},[1585],"height:2.1248em;vertical-align:-0.8034em;",[383,14454,14456,14459,14867],{"className":14455},[1590],[383,14457],{"className":14458},[2025,5119],[383,14460,14462],{"className":14461},[5025],[383,14463,14465,14858],{"className":14464},[2041,2042],[383,14466,14468,14855],{"className":14467},[2046],[383,14469,14471,14836,14844],{"className":14470,"style":5132},[2050],[383,14472,14474,14477],{"style":14473},"top:-2.2799em;",[383,14475],{"className":14476,"style":4587},[2058],[383,14478,14480,14483,14486,14489,14492],{"className":14479},[1590],[383,14481,1943],{"className":14482},[1590],[383,14484],{"className":14485,"style":2577},[1594],[383,14487,2916],{"className":14488},[3048],[383,14490],{"className":14491,"style":2577},[1594],[383,14493,14495,14498],{"className":14494},[1590],[383,14496,12290],{"className":14497},[1590,2033],[383,14499,14501],{"className":14500},[2037],[383,14502,14504],{"className":14503},[2041],[383,14505,14507],{"className":14506},[2046],[383,14508,14511],{"className":14509,"style":14510},[2050],"height:0.8301em;",[383,14512,14514,14517],{"style":14513},"top:-3.0051em;margin-right:0.05em;",[383,14515],{"className":14516,"style":2059},[2058],[383,14518,14520],{"className":14519},[2063,2064,2065,2066],[383,14521,14523,14526,14529,14575,14578,14618,14659,14662,14702,14742,14745,14748,14751,14793,14833],{"className":14522},[1590,2066],[383,14524,1680],{"className":14525},[1590,2066],[383,14527,1933],{"className":14528},[2025,2066],[383,14530,14532,14535],{"className":14531},[1590,2066],[383,14533,2910],{"className":14534,"style":3006},[1590,2033,2066],[383,14536,14538],{"className":14537},[2037],[383,14539,14541,14566],{"className":14540},[2041,2042],[383,14542,14544,14563],{"className":14543},[2046],[383,14545,14548],{"className":14546,"style":14547},[2050],"height:0.3173em;",[383,14549,14551,14555],{"style":14550},"top:-2.357em;margin-left:-0.0528em;margin-right:0.0714em;",[383,14552],{"className":14553,"style":14554},[2058],"height:2.5em;",[383,14556,14560],{"className":14557},[2063,14558,14559,2066],"reset-size3","size1",[383,14561,2913],{"className":14562},[1590,2066],[383,14564,2074],{"className":14565},[2073],[383,14567,14569],{"className":14568},[2046],[383,14570,14573],{"className":14571,"style":14572},[2050],"height:0.143em;",[383,14574],{},[383,14576,2916],{"className":14577},[3048,2066],[383,14579,14581,14584],{"className":14580},[1590,2066],[383,14582,2910],{"className":14583,"style":3006},[1590,2033,2066],[383,14585,14587],{"className":14586},[2037],[383,14588,14590,14610],{"className":14589},[2041,2042],[383,14591,14593,14607],{"className":14592},[2046],[383,14594,14596],{"className":14595,"style":14547},[2050],[383,14597,14598,14601],{"style":14550},[383,14599],{"className":14600,"style":14554},[2058],[383,14602,14604],{"className":14603},[2063,14558,14559,2066],[383,14605,1943],{"className":14606},[1590,2066],[383,14608,2074],{"className":14609},[2073],[383,14611,14613],{"className":14612},[2046],[383,14614,14616],{"className":14615,"style":14572},[2050],[383,14617],{},[383,14619,14621,14624],{"className":14620},[1590,2066],[383,14622,1940],{"className":14623},[1590,2033,2066],[383,14625,14627],{"className":14626},[2037],[383,14628,14630,14651],{"className":14629},[2041,2042],[383,14631,14633,14648],{"className":14632},[2046],[383,14634,14636],{"className":14635,"style":14547},[2050],[383,14637,14639,14642],{"style":14638},"top:-2.357em;margin-left:0em;margin-right:0.0714em;",[383,14640],{"className":14641,"style":14554},[2058],[383,14643,14645],{"className":14644},[2063,14558,14559,2066],[383,14646,1943],{"className":14647},[1590,2066],[383,14649,2074],{"className":14650},[2073],[383,14652,14654],{"className":14653},[2046],[383,14655,14657],{"className":14656,"style":14572},[2050],[383,14658],{},[383,14660,2916],{"className":14661},[3048,2066],[383,14663,14665,14668],{"className":14664},[1590,2066],[383,14666,2910],{"className":14667,"style":3006},[1590,2033,2066],[383,14669,14671],{"className":14670},[2037],[383,14672,14674,14694],{"className":14673},[2041,2042],[383,14675,14677,14691],{"className":14676},[2046],[383,14678,14680],{"className":14679,"style":14547},[2050],[383,14681,14682,14685],{"style":14550},[383,14683],{"className":14684,"style":14554},[2058],[383,14686,14688],{"className":14687},[2063,14558,14559,2066],[383,14689,1563],{"className":14690},[1590,2066],[383,14692,2074],{"className":14693},[2073],[383,14695,14697],{"className":14696},[2046],[383,14698,14700],{"className":14699,"style":14572},[2050],[383,14701],{},[383,14703,14705,14708],{"className":14704},[1590,2066],[383,14706,1940],{"className":14707},[1590,2033,2066],[383,14709,14711],{"className":14710},[2037],[383,14712,14714,14734],{"className":14713},[2041,2042],[383,14715,14717,14731],{"className":14716},[2046],[383,14718,14720],{"className":14719,"style":14547},[2050],[383,14721,14722,14725],{"style":14638},[383,14723],{"className":14724,"style":14554},[2058],[383,14726,14728],{"className":14727},[2063,14558,14559,2066],[383,14729,1563],{"className":14730},[1590,2066],[383,14732,2074],{"className":14733},[2073],[383,14735,14737],{"className":14736},[2046],[383,14738,14740],{"className":14739,"style":14572},[2050],[383,14741],{},[383,14743,2916],{"className":14744},[3048,2066],[383,14746,2243],{"className":14747},[1590,2066],[383,14749,2916],{"className":14750},[3048,2066],[383,14752,14754,14757],{"className":14753},[1590,2066],[383,14755,2910],{"className":14756,"style":3006},[1590,2033,2066],[383,14758,14760],{"className":14759},[2037],[383,14761,14763,14784],{"className":14762},[2041,2042],[383,14764,14766,14781],{"className":14765},[2046],[383,14767,14770],{"className":14768,"style":14769},[2050],"height:0.1645em;",[383,14771,14772,14775],{"style":14550},[383,14773],{"className":14774,"style":14554},[2058],[383,14776,14778],{"className":14777},[2063,14558,14559,2066],[383,14779,11],{"className":14780},[1590,2033,2066],[383,14782,2074],{"className":14783},[2073],[383,14785,14787],{"className":14786},[2046],[383,14788,14791],{"className":14789,"style":14790},[2050],"height:0.2819em;",[383,14792],{},[383,14794,14796,14799],{"className":14795},[1590,2066],[383,14797,1940],{"className":14798},[1590,2033,2066],[383,14800,14802],{"className":14801},[2037],[383,14803,14805,14825],{"className":14804},[2041,2042],[383,14806,14808,14822],{"className":14807},[2046],[383,14809,14811],{"className":14810,"style":14769},[2050],[383,14812,14813,14816],{"style":14638},[383,14814],{"className":14815,"style":14554},[2058],[383,14817,14819],{"className":14818},[2063,14558,14559,2066],[383,14820,11],{"className":14821},[1590,2033,2066],[383,14823,2074],{"className":14824},[2073],[383,14826,14828],{"className":14827},[2046],[383,14829,14831],{"className":14830,"style":14790},[2050],[383,14832],{},[383,14834,1955],{"className":14835},[2135,2066],[383,14837,14838,14841],{"style":5147},[383,14839],{"className":14840,"style":4587},[2058],[383,14842],{"className":14843,"style":5155},[5154],[383,14845,14846,14849],{"style":5158},[383,14847],{"className":14848,"style":4587},[2058],[383,14850,14852],{"className":14851},[1590],[383,14853,1943],{"className":14854},[1590],[383,14856,2074],{"className":14857},[2073],[383,14859,14861],{"className":14860},[2046],[383,14862,14865],{"className":14863,"style":14864},[2050],"height:0.8034em;",[383,14866],{},[383,14868],{"className":14869},[2135,5119],[11,14871,3370],{},[34,14873,14874,14946,15142,15339],{},[37,14875,14876,14945],{},[383,14877,14879,14896],{"className":14878},[1545],[383,14880,14882],{"className":14881},[1549],[1551,14883,14884],{"xmlns":1553},[1555,14885,14886,14894],{},[1558,14887,14888],{},[1935,14889,14890,14892],{},[1938,14891,2910],{},[1561,14893,2913],{},[1569,14895,3625],{"encoding":1571},[383,14897,14899],{"className":14898,"ariaHidden":1577},[1576],[383,14900,14902,14905],{"className":14901},[1581],[383,14903],{"className":14904,"style":2534},[1585],[383,14906,14908,14911],{"className":14907},[1590],[383,14909,2910],{"className":14910,"style":3006},[1590,2033],[383,14912,14914],{"className":14913},[2037],[383,14915,14917,14937],{"className":14916},[2041,2042],[383,14918,14920,14934],{"className":14919},[2046],[383,14921,14923],{"className":14922,"style":2051},[2050],[383,14924,14925,14928],{"style":3021},[383,14926],{"className":14927,"style":2059},[2058],[383,14929,14931],{"className":14930},[2063,2064,2065,2066],[383,14932,2913],{"className":14933},[1590,2066],[383,14935,2074],{"className":14936},[2073],[383,14938,14940],{"className":14939},[2046],[383,14941,14943],{"className":14942,"style":2081},[2050],[383,14944],{}," is the intercept.",[37,14947,14948,3931],{},[383,14949,14951,14992],{"className":14950},[1545],[383,14952,14954],{"className":14953},[1549],[1551,14955,14956],{"xmlns":1553},[1555,14957,14958,14990],{},[1558,14959,14960,14966,14968,14974,14976,14978,14980,14982,14984],{},[1935,14961,14962,14964],{},[1938,14963,2910],{},[1561,14965,1943],{},[1565,14967,1674],{"separator":1577},[1935,14969,14970,14972],{},[1938,14971,2910],{},[1561,14973,1563],{},[1565,14975,1674],{"separator":1577},[1938,14977,1497],{"mathvariant":1980},[1938,14979,1497],{"mathvariant":1980},[1938,14981,1497],{"mathvariant":1980},[1565,14983,1674],{"separator":1577},[1935,14985,14986,14988],{},[1938,14987,2910],{},[1938,14989,11],{},[1569,14991,3780],{"encoding":1571},[383,14993,14995],{"className":14994,"ariaHidden":1577},[1576],[383,14996,14998,15001,15041,15044,15047,15087,15090,15093,15096,15099,15102],{"className":14997},[1581],[383,14999],{"className":15000,"style":3267},[1585],[383,15002,15004,15007],{"className":15003},[1590],[383,15005,2910],{"className":15006,"style":3006},[1590,2033],[383,15008,15010],{"className":15009},[2037],[383,15011,15013,15033],{"className":15012},[2041,2042],[383,15014,15016,15030],{"className":15015},[2046],[383,15017,15019],{"className":15018,"style":2051},[2050],[383,15020,15021,15024],{"style":3021},[383,15022],{"className":15023,"style":2059},[2058],[383,15025,15027],{"className":15026},[2063,2064,2065,2066],[383,15028,1943],{"className":15029},[1590,2066],[383,15031,2074],{"className":15032},[2073],[383,15034,15036],{"className":15035},[2046],[383,15037,15039],{"className":15038,"style":2081},[2050],[383,15040],{},[383,15042,1674],{"className":15043},[1700],[383,15045],{"className":15046,"style":1704},[1594],[383,15048,15050,15053],{"className":15049},[1590],[383,15051,2910],{"className":15052,"style":3006},[1590,2033],[383,15054,15056],{"className":15055},[2037],[383,15057,15059,15079],{"className":15058},[2041,2042],[383,15060,15062,15076],{"className":15061},[2046],[383,15063,15065],{"className":15064,"style":2051},[2050],[383,15066,15067,15070],{"style":3021},[383,15068],{"className":15069,"style":2059},[2058],[383,15071,15073],{"className":15072},[2063,2064,2065,2066],[383,15074,1563],{"className":15075},[1590,2066],[383,15077,2074],{"className":15078},[2073],[383,15080,15082],{"className":15081},[2046],[383,15083,15085],{"className":15084,"style":2081},[2050],[383,15086],{},[383,15088,1674],{"className":15089},[1700],[383,15091],{"className":15092,"style":1704},[1594],[383,15094,2243],{"className":15095},[1590],[383,15097,1674],{"className":15098},[1700],[383,15100],{"className":15101,"style":1704},[1594],[383,15103,15105,15108],{"className":15104},[1590],[383,15106,2910],{"className":15107,"style":3006},[1590,2033],[383,15109,15111],{"className":15110},[2037],[383,15112,15114,15134],{"className":15113},[2041,2042],[383,15115,15117,15131],{"className":15116},[2046],[383,15118,15120],{"className":15119,"style":2271},[2050],[383,15121,15122,15125],{"style":3021},[383,15123],{"className":15124,"style":2059},[2058],[383,15126,15128],{"className":15127},[2063,2064,2065,2066],[383,15129,11],{"className":15130},[1590,2033,2066],[383,15132,2074],{"className":15133},[2073],[383,15135,15137],{"className":15136},[2046],[383,15138,15140],{"className":15139,"style":3306},[2050],[383,15141],{},[37,15143,15144,15338],{},[383,15145,15147,15188],{"className":15146},[1545],[383,15148,15150],{"className":15149},[1549],[1551,15151,15152],{"xmlns":1553},[1555,15153,15154,15186],{},[1558,15155,15156,15162,15164,15170,15172,15174,15176,15178,15180],{},[1935,15157,15158,15160],{},[1938,15159,1940],{},[1561,15161,1943],{},[1565,15163,1674],{"separator":1577},[1935,15165,15166,15168],{},[1938,15167,1940],{},[1561,15169,1563],{},[1565,15171,1674],{"separator":1577},[1938,15173,1497],{"mathvariant":1980},[1938,15175,1497],{"mathvariant":1980},[1938,15177,1497],{"mathvariant":1980},[1565,15179,1674],{"separator":1577},[1935,15181,15182,15184],{},[1938,15183,1940],{},[1938,15185,11],{},[1569,15187,3450],{"encoding":1571},[383,15189,15191],{"className":15190,"ariaHidden":1577},[1576],[383,15192,15194,15197,15237,15240,15243,15283,15286,15289,15292,15295,15298],{"className":15193},[1581],[383,15195],{"className":15196,"style":3460},[1585],[383,15198,15200,15203],{"className":15199},[1590],[383,15201,1940],{"className":15202},[1590,2033],[383,15204,15206],{"className":15205},[2037],[383,15207,15209,15229],{"className":15208},[2041,2042],[383,15210,15212,15226],{"className":15211},[2046],[383,15213,15215],{"className":15214,"style":2051},[2050],[383,15216,15217,15220],{"style":2054},[383,15218],{"className":15219,"style":2059},[2058],[383,15221,15223],{"className":15222},[2063,2064,2065,2066],[383,15224,1943],{"className":15225},[1590,2066],[383,15227,2074],{"className":15228},[2073],[383,15230,15232],{"className":15231},[2046],[383,15233,15235],{"className":15234,"style":2081},[2050],[383,15236],{},[383,15238,1674],{"className":15239},[1700],[383,15241],{"className":15242,"style":1704},[1594],[383,15244,15246,15249],{"className":15245},[1590],[383,15247,1940],{"className":15248},[1590,2033],[383,15250,15252],{"className":15251},[2037],[383,15253,15255,15275],{"className":15254},[2041,2042],[383,15256,15258,15272],{"className":15257},[2046],[383,15259,15261],{"className":15260,"style":2051},[2050],[383,15262,15263,15266],{"style":2054},[383,15264],{"className":15265,"style":2059},[2058],[383,15267,15269],{"className":15268},[2063,2064,2065,2066],[383,15270,1563],{"className":15271},[1590,2066],[383,15273,2074],{"className":15274},[2073],[383,15276,15278],{"className":15277},[2046],[383,15279,15281],{"className":15280,"style":2081},[2050],[383,15282],{},[383,15284,1674],{"className":15285},[1700],[383,15287],{"className":15288,"style":1704},[1594],[383,15290,2243],{"className":15291},[1590],[383,15293,1674],{"className":15294},[1700],[383,15296],{"className":15297,"style":1704},[1594],[383,15299,15301,15304],{"className":15300},[1590],[383,15302,1940],{"className":15303},[1590,2033],[383,15305,15307],{"className":15306},[2037],[383,15308,15310,15330],{"className":15309},[2041,2042],[383,15311,15313,15327],{"className":15312},[2046],[383,15314,15316],{"className":15315,"style":2271},[2050],[383,15317,15318,15321],{"style":2054},[383,15319],{"className":15320,"style":2059},[2058],[383,15322,15324],{"className":15323},[2063,2064,2065,2066],[383,15325,11],{"className":15326},[1590,2033,2066],[383,15328,2074],{"className":15329},[2073],[383,15331,15333],{"className":15332},[2046],[383,15334,15336],{"className":15335,"style":3306},[2050],[383,15337],{}," are the features or independent variables.",[37,15340,15341,13522],{},[383,15342,15344,15371],{"className":15343},[1545],[383,15345,15347],{"className":15346},[1549],[1551,15348,15349],{"xmlns":1553},[1555,15350,15351,15369],{},[1558,15352,15353,15355,15357,15359,15361,15363,15365,15367],{},[1938,15354,13344],{},[1565,15356,1933],{"stretchy":1929},[1938,15358,1950],{},[1565,15360,1567],{},[1561,15362,1943],{},[1938,15364,13355],{"mathvariant":1980},[1938,15366,1940],{},[1565,15368,1955],{"stretchy":1929},[1569,15370,13479],{"encoding":1571},[383,15372,15374,15398],{"className":15373,"ariaHidden":1577},[1576],[383,15375,15377,15380,15383,15386,15389,15392,15395],{"className":15376},[1581],[383,15378],{"className":15379,"style":2021},[1585],[383,15381,13344],{"className":15382,"style":13385},[1590,2033],[383,15384,1933],{"className":15385},[2025],[383,15387,1950],{"className":15388,"style":2096},[1590,2033],[383,15390],{"className":15391,"style":1595},[1594],[383,15393,1567],{"className":15394},[1599],[383,15396],{"className":15397,"style":1595},[1594],[383,15399,15401,15404,15407,15410],{"className":15400},[1581],[383,15402],{"className":15403,"style":2021},[1585],[383,15405,13410],{"className":15406},[1590],[383,15408,1940],{"className":15409},[1590,2033],[383,15411,1955],{"className":15412},[2135],[11,15414,15415],{},"Each feature provides evidence for or against a particular class. For example, if the word \"free\" appears in an email, it might increase the probability that it is spam. On the other hand, if the word \"meeting\" appears, it might decrease the probability of it being spam.",[293,15417,15418],{},[11,15419,15420],{},"This gives us not only a classification but also a measure of confidence in that classification through the probability calculated by the sigmoid function.",[11,15422,15423],{},"The sigmoid function transforms any real value into a value between 0 and 1. The formula as shown above is:",[383,15425,15427],{"className":15426},[2494],[383,15428,15430,15471],{"className":15429},[1545],[383,15431,15433],{"className":15432},[1549],[1551,15434,15435],{"xmlns":1553,"display":2503},[1555,15436,15437,15469],{},[1558,15438,15439,15441,15443,15445,15447,15449],{},[1938,15440,14062],{},[1565,15442,1933],{"stretchy":1929},[1938,15444,13603],{},[1565,15446,1955],{"stretchy":1929},[1565,15448,1567],{},[5025,15450,15451,15453],{},[1561,15452,1943],{},[1558,15454,15455,15457,15459],{},[1561,15456,1943],{},[1565,15458,2916],{},[5068,15460,15461,15463],{},[1938,15462,12290],{},[1558,15464,15465,15467],{},[1565,15466,1680],{},[1938,15468,13603],{},[1569,15470,14093],{"encoding":1571},[383,15472,15474,15501],{"className":15473,"ariaHidden":1577},[1576],[383,15475,15477,15480,15483,15486,15489,15492,15495,15498],{"className":15476},[1581],[383,15478],{"className":15479,"style":2021},[1585],[383,15481,14062],{"className":15482,"style":2096},[1590,2033],[383,15484,1933],{"className":15485},[2025],[383,15487,13603],{"className":15488,"style":13677},[1590,2033],[383,15490,1955],{"className":15491},[2135],[383,15493],{"className":15494,"style":1595},[1594],[383,15496,1567],{"className":15497},[1599],[383,15499],{"className":15500,"style":1595},[1594],[383,15502,15504,15507],{"className":15503},[1581],[383,15505],{"className":15506,"style":14130},[1585],[383,15508,15510,15513,15610],{"className":15509},[1590],[383,15511],{"className":15512},[2025,5119],[383,15514,15516],{"className":15515},[5025],[383,15517,15519,15602],{"className":15518},[2041,2042],[383,15520,15522,15599],{"className":15521},[2046],[383,15523,15525,15580,15588],{"className":15524,"style":5132},[2050],[383,15526,15527,15530],{"style":5135},[383,15528],{"className":15529,"style":4587},[2058],[383,15531,15533,15536,15539,15542,15545],{"className":15532},[1590],[383,15534,1943],{"className":15535},[1590],[383,15537],{"className":15538,"style":2577},[1594],[383,15540,2916],{"className":15541},[3048],[383,15543],{"className":15544,"style":2577},[1594],[383,15546,15548,15551],{"className":15547},[1590],[383,15549,12290],{"className":15550},[1590,2033],[383,15552,15554],{"className":15553},[2037],[383,15555,15557],{"className":15556},[2041],[383,15558,15560],{"className":15559},[2046],[383,15561,15563],{"className":15562,"style":14187},[2050],[383,15564,15565,15568],{"style":6969},[383,15566],{"className":15567,"style":2059},[2058],[383,15569,15571],{"className":15570},[2063,2064,2065,2066],[383,15572,15574,15577],{"className":15573},[1590,2066],[383,15575,1680],{"className":15576},[1590,2066],[383,15578,13603],{"className":15579,"style":13677},[1590,2033,2066],[383,15581,15582,15585],{"style":5147},[383,15583],{"className":15584,"style":4587},[2058],[383,15586],{"className":15587,"style":5155},[5154],[383,15589,15590,15593],{"style":5158},[383,15591],{"className":15592,"style":4587},[2058],[383,15594,15596],{"className":15595},[1590],[383,15597,1943],{"className":15598},[1590],[383,15600,2074],{"className":15601},[2073],[383,15603,15605],{"className":15604},[2046],[383,15606,15608],{"className":15607,"style":14233},[2050],[383,15609],{},[383,15611],{"className":15612},[2135,5119],[11,15614,3370],{},[34,15616,15617,16092,16123],{},[37,15618,15619,15647,15648,1497],{},[383,15620,15622,15635],{"className":15621},[1545],[383,15623,15625],{"className":15624},[1549],[1551,15626,15627],{"xmlns":1553},[1555,15628,15629,15633],{},[1558,15630,15631],{},[1938,15632,13603],{},[1569,15634,13603],{"encoding":1571},[383,15636,15638],{"className":15637,"ariaHidden":1577},[1576],[383,15639,15641,15644],{"className":15640},[1581],[383,15642],{"className":15643,"style":3364},[1585],[383,15645,13603],{"className":15646,"style":13677},[1590,2033]," is the linear combination of the features, that is, ",[383,15649,15651,15722],{"className":15650},[1545],[383,15652,15654],{"className":15653},[1549],[1551,15655,15656],{"xmlns":1553},[1555,15657,15658,15720],{},[1558,15659,15660,15662,15664,15670,15672,15678,15684,15686,15692,15698,15700,15702,15704,15706,15708,15714],{},[1938,15661,13603],{},[1565,15663,1567],{},[1935,15665,15666,15668],{},[1938,15667,2910],{},[1561,15669,2913],{},[1565,15671,2916],{},[1935,15673,15674,15676],{},[1938,15675,2910],{},[1561,15677,1943],{},[1935,15679,15680,15682],{},[1938,15681,1940],{},[1561,15683,1943],{},[1565,15685,2916],{},[1935,15687,15688,15690],{},[1938,15689,2910],{},[1561,15691,1563],{},[1935,15693,15694,15696],{},[1938,15695,1940],{},[1561,15697,1563],{},[1565,15699,2916],{},[1938,15701,1497],{"mathvariant":1980},[1938,15703,1497],{"mathvariant":1980},[1938,15705,1497],{"mathvariant":1980},[1565,15707,2916],{},[1935,15709,15710,15712],{},[1938,15711,2910],{},[1938,15713,11],{},[1935,15715,15716,15718],{},[1938,15717,1940],{},[1938,15719,11],{},[1569,15721,13664],{"encoding":1571},[383,15723,15725,15743,15798,15893,15988,16006],{"className":15724,"ariaHidden":1577},[1576],[383,15726,15728,15731,15734,15737,15740],{"className":15727},[1581],[383,15729],{"className":15730,"style":3364},[1585],[383,15732,13603],{"className":15733,"style":13677},[1590,2033],[383,15735],{"className":15736,"style":1595},[1594],[383,15738,1567],{"className":15739},[1599],[383,15741],{"className":15742,"style":1595},[1594],[383,15744,15746,15749,15789,15792,15795],{"className":15745},[1581],[383,15747],{"className":15748,"style":2534},[1585],[383,15750,15752,15755],{"className":15751},[1590],[383,15753,2910],{"className":15754,"style":3006},[1590,2033],[383,15756,15758],{"className":15757},[2037],[383,15759,15761,15781],{"className":15760},[2041,2042],[383,15762,15764,15778],{"className":15763},[2046],[383,15765,15767],{"className":15766,"style":2051},[2050],[383,15768,15769,15772],{"style":3021},[383,15770],{"className":15771,"style":2059},[2058],[383,15773,15775],{"className":15774},[2063,2064,2065,2066],[383,15776,2913],{"className":15777},[1590,2066],[383,15779,2074],{"className":15780},[2073],[383,15782,15784],{"className":15783},[2046],[383,15785,15787],{"className":15786,"style":2081},[2050],[383,15788],{},[383,15790],{"className":15791,"style":2577},[1594],[383,15793,2916],{"className":15794},[3048],[383,15796],{"className":15797,"style":2577},[1594],[383,15799,15801,15804,15844,15884,15887,15890],{"className":15800},[1581],[383,15802],{"className":15803,"style":2534},[1585],[383,15805,15807,15810],{"className":15806},[1590],[383,15808,2910],{"className":15809,"style":3006},[1590,2033],[383,15811,15813],{"className":15812},[2037],[383,15814,15816,15836],{"className":15815},[2041,2042],[383,15817,15819,15833],{"className":15818},[2046],[383,15820,15822],{"className":15821,"style":2051},[2050],[383,15823,15824,15827],{"style":3021},[383,15825],{"className":15826,"style":2059},[2058],[383,15828,15830],{"className":15829},[2063,2064,2065,2066],[383,15831,1943],{"className":15832},[1590,2066],[383,15834,2074],{"className":15835},[2073],[383,15837,15839],{"className":15838},[2046],[383,15840,15842],{"className":15841,"style":2081},[2050],[383,15843],{},[383,15845,15847,15850],{"className":15846},[1590],[383,15848,1940],{"className":15849},[1590,2033],[383,15851,15853],{"className":15852},[2037],[383,15854,15856,15876],{"className":15855},[2041,2042],[383,15857,15859,15873],{"className":15858},[2046],[383,15860,15862],{"className":15861,"style":2051},[2050],[383,15863,15864,15867],{"style":2054},[383,15865],{"className":15866,"style":2059},[2058],[383,15868,15870],{"className":15869},[2063,2064,2065,2066],[383,15871,1943],{"className":15872},[1590,2066],[383,15874,2074],{"className":15875},[2073],[383,15877,15879],{"className":15878},[2046],[383,15880,15882],{"className":15881,"style":2081},[2050],[383,15883],{},[383,15885],{"className":15886,"style":2577},[1594],[383,15888,2916],{"className":15889},[3048],[383,15891],{"className":15892,"style":2577},[1594],[383,15894,15896,15899,15939,15979,15982,15985],{"className":15895},[1581],[383,15897],{"className":15898,"style":2534},[1585],[383,15900,15902,15905],{"className":15901},[1590],[383,15903,2910],{"className":15904,"style":3006},[1590,2033],[383,15906,15908],{"className":15907},[2037],[383,15909,15911,15931],{"className":15910},[2041,2042],[383,15912,15914,15928],{"className":15913},[2046],[383,15915,15917],{"className":15916,"style":2051},[2050],[383,15918,15919,15922],{"style":3021},[383,15920],{"className":15921,"style":2059},[2058],[383,15923,15925],{"className":15924},[2063,2064,2065,2066],[383,15926,1563],{"className":15927},[1590,2066],[383,15929,2074],{"className":15930},[2073],[383,15932,15934],{"className":15933},[2046],[383,15935,15937],{"className":15936,"style":2081},[2050],[383,15938],{},[383,15940,15942,15945],{"className":15941},[1590],[383,15943,1940],{"className":15944},[1590,2033],[383,15946,15948],{"className":15947},[2037],[383,15949,15951,15971],{"className":15950},[2041,2042],[383,15952,15954,15968],{"className":15953},[2046],[383,15955,15957],{"className":15956,"style":2051},[2050],[383,15958,15959,15962],{"style":2054},[383,15960],{"className":15961,"style":2059},[2058],[383,15963,15965],{"className":15964},[2063,2064,2065,2066],[383,15966,1563],{"className":15967},[1590,2066],[383,15969,2074],{"className":15970},[2073],[383,15972,15974],{"className":15973},[2046],[383,15975,15977],{"className":15976,"style":2081},[2050],[383,15978],{},[383,15980],{"className":15981,"style":2577},[1594],[383,15983,2916],{"className":15984},[3048],[383,15986],{"className":15987,"style":2577},[1594],[383,15989,15991,15994,15997,16000,16003],{"className":15990},[1581],[383,15992],{"className":15993,"style":3248},[1585],[383,15995,2243],{"className":15996},[1590],[383,15998],{"className":15999,"style":2577},[1594],[383,16001,2916],{"className":16002},[3048],[383,16004],{"className":16005,"style":2577},[1594],[383,16007,16009,16012,16052],{"className":16008},[1581],[383,16010],{"className":16011,"style":3267},[1585],[383,16013,16015,16018],{"className":16014},[1590],[383,16016,2910],{"className":16017,"style":3006},[1590,2033],[383,16019,16021],{"className":16020},[2037],[383,16022,16024,16044],{"className":16023},[2041,2042],[383,16025,16027,16041],{"className":16026},[2046],[383,16028,16030],{"className":16029,"style":2271},[2050],[383,16031,16032,16035],{"style":3021},[383,16033],{"className":16034,"style":2059},[2058],[383,16036,16038],{"className":16037},[2063,2064,2065,2066],[383,16039,11],{"className":16040},[1590,2033,2066],[383,16042,2074],{"className":16043},[2073],[383,16045,16047],{"className":16046},[2046],[383,16048,16050],{"className":16049,"style":3306},[2050],[383,16051],{},[383,16053,16055,16058],{"className":16054},[1590],[383,16056,1940],{"className":16057},[1590,2033],[383,16059,16061],{"className":16060},[2037],[383,16062,16064,16084],{"className":16063},[2041,2042],[383,16065,16067,16081],{"className":16066},[2046],[383,16068,16070],{"className":16069,"style":2271},[2050],[383,16071,16072,16075],{"style":2054},[383,16073],{"className":16074,"style":2059},[2058],[383,16076,16078],{"className":16077},[2063,2064,2065,2066],[383,16079,11],{"className":16080},[1590,2033,2066],[383,16082,2074],{"className":16083},[2073],[383,16085,16087],{"className":16086},[2046],[383,16088,16090],{"className":16089,"style":3306},[2050],[383,16091],{},[37,16093,16094,16122],{},[383,16095,16097,16110],{"className":16096},[1545],[383,16098,16100],{"className":16099},[1549],[1551,16101,16102],{"xmlns":1553},[1555,16103,16104,16108],{},[1558,16105,16106],{},[1938,16107,12290],{},[1569,16109,12290],{"encoding":1571},[383,16111,16113],{"className":16112,"ariaHidden":1577},[1576],[383,16114,16116,16119],{"className":16115},[1581],[383,16117],{"className":16118,"style":3364},[1585],[383,16120,12290],{"className":16121},[1590,2033]," is Euler's number, approximately equal to 2.71828.",[37,16124,16125,16169],{},[383,16126,16128,16148],{"className":16127},[1545],[383,16129,16131],{"className":16130},[1549],[1551,16132,16133],{"xmlns":1553},[1555,16134,16135,16145],{},[1558,16136,16137,16139,16141,16143],{},[1938,16138,14062],{},[1565,16140,1933],{"stretchy":1929},[1938,16142,13603],{},[1565,16144,1955],{"stretchy":1929},[1569,16146,16147],{"encoding":1571},"\\sigma(z)",[383,16149,16151],{"className":16150,"ariaHidden":1577},[1576],[383,16152,16154,16157,16160,16163,16166],{"className":16153},[1581],[383,16155],{"className":16156,"style":2021},[1585],[383,16158,14062],{"className":16159,"style":2096},[1590,2033],[383,16161,1933],{"className":16162},[2025],[383,16164,13603],{"className":16165,"style":13677},[1590,2033],[383,16167,1955],{"className":16168},[2135]," is the output of the sigmoid function, which represents the probability of the class being 1 given the value of z (range between 0 and 1).",[11,16171,16172,16173,16216,16217,16221],{},"Visually it looks something like this (with z on the X-axis and ",[383,16174,16176,16195],{"className":16175},[1545],[383,16177,16179],{"className":16178},[1549],[1551,16180,16181],{"xmlns":1553},[1555,16182,16183,16193],{},[1558,16184,16185,16187,16189,16191],{},[1938,16186,14062],{},[1565,16188,1933],{"stretchy":1929},[1938,16190,13603],{},[1565,16192,1955],{"stretchy":1929},[1569,16194,16147],{"encoding":1571},[383,16196,16198],{"className":16197,"ariaHidden":1577},[1576],[383,16199,16201,16204,16207,16210,16213],{"className":16200},[1581],[383,16202],{"className":16203,"style":2021},[1585],[383,16205,14062],{"className":16206,"style":2096},[1590,2033],[383,16208,1933],{"className":16209},[2025],[383,16211,13603],{"className":16212,"style":13677},[1590,2033],[383,16214,1955],{"className":16215},[2135]," on the Y-axis):\n",[80,16218],{"alt":16219,"src":16220},"Sigmoid Function Graph","\u002Fblog\u002Fmachine-learning-paradigms-and-mathematical-foundations\u002Fshared\u002Fsigmoid-function.webp",[85,16222,16219],{},[11,16224,16225],{},"From this we can draw some important conclusions:",[34,16227,16228,16275,16322],{},[37,16229,16230,16231,16274],{},"When z is very negative, ",[383,16232,16234,16253],{"className":16233},[1545],[383,16235,16237],{"className":16236},[1549],[1551,16238,16239],{"xmlns":1553},[1555,16240,16241,16251],{},[1558,16242,16243,16245,16247,16249],{},[1938,16244,14062],{},[1565,16246,1933],{"stretchy":1929},[1938,16248,13603],{},[1565,16250,1955],{"stretchy":1929},[1569,16252,16147],{"encoding":1571},[383,16254,16256],{"className":16255,"ariaHidden":1577},[1576],[383,16257,16259,16262,16265,16268,16271],{"className":16258},[1581],[383,16260],{"className":16261,"style":2021},[1585],[383,16263,14062],{"className":16264,"style":2096},[1590,2033],[383,16266,1933],{"className":16267},[2025],[383,16269,13603],{"className":16270,"style":13677},[1590,2033],[383,16272,1955],{"className":16273},[2135]," approaches 0, indicating a low probability that the class is 1.",[37,16276,16277,16278,16321],{},"When z is very positive, ",[383,16279,16281,16300],{"className":16280},[1545],[383,16282,16284],{"className":16283},[1549],[1551,16285,16286],{"xmlns":1553},[1555,16287,16288,16298],{},[1558,16289,16290,16292,16294,16296],{},[1938,16291,14062],{},[1565,16293,1933],{"stretchy":1929},[1938,16295,13603],{},[1565,16297,1955],{"stretchy":1929},[1569,16299,16147],{"encoding":1571},[383,16301,16303],{"className":16302,"ariaHidden":1577},[1576],[383,16304,16306,16309,16312,16315,16318],{"className":16305},[1581],[383,16307],{"className":16308,"style":2021},[1585],[383,16310,14062],{"className":16311,"style":2096},[1590,2033],[383,16313,1933],{"className":16314},[2025],[383,16316,13603],{"className":16317,"style":13677},[1590,2033],[383,16319,1955],{"className":16320},[2135]," approaches 1, indicating a high probability that the class is 1.",[37,16323,16324,16325,16368],{},"When z is 0, ",[383,16326,16328,16347],{"className":16327},[1545],[383,16329,16331],{"className":16330},[1549],[1551,16332,16333],{"xmlns":1553},[1555,16334,16335,16345],{},[1558,16336,16337,16339,16341,16343],{},[1938,16338,14062],{},[1565,16340,1933],{"stretchy":1929},[1938,16342,13603],{},[1565,16344,1955],{"stretchy":1929},[1569,16346,16147],{"encoding":1571},[383,16348,16350],{"className":16349,"ariaHidden":1577},[1576],[383,16351,16353,16356,16359,16362,16365],{"className":16352},[1581],[383,16354],{"className":16355,"style":2021},[1585],[383,16357,14062],{"className":16358,"style":2096},[1590,2033],[383,16360,1933],{"className":16361},[2025],[383,16363,13603],{"className":16364,"style":13677},[1590,2033],[383,16366,1955],{"className":16367},[2135]," is 0.5, indicating an equal probability that the class is 0 or 1.",[11,16370,16371,16372,16375],{},"The value of 0.5 ",[40,16373,16374],{},"is commonly used as a threshold",", so that:",[34,16377,16378,16450],{},[37,16379,16380,16381,16449],{},"If ",[383,16382,16384,16410],{"className":16383},[1545],[383,16385,16387],{"className":16386},[1549],[1551,16388,16389],{"xmlns":1553},[1555,16390,16391,16407],{},[1558,16392,16393,16395,16397,16399,16401,16404],{},[1938,16394,14062],{},[1565,16396,1933],{"stretchy":1929},[1938,16398,13603],{},[1565,16400,1955],{"stretchy":1929},[1565,16402,16403],{},"≥",[1561,16405,16406],{},"0.5",[1569,16408,16409],{"encoding":1571},"\\sigma(z) \\geq 0.5",[383,16411,16413,16440],{"className":16412,"ariaHidden":1577},[1576],[383,16414,16416,16419,16422,16425,16428,16431,16434,16437],{"className":16415},[1581],[383,16417],{"className":16418,"style":2021},[1585],[383,16420,14062],{"className":16421,"style":2096},[1590,2033],[383,16423,1933],{"className":16424},[2025],[383,16426,13603],{"className":16427,"style":13677},[1590,2033],[383,16429,1955],{"className":16430},[2135],[383,16432],{"className":16433,"style":1595},[1594],[383,16435,16403],{"className":16436},[1599],[383,16438],{"className":16439,"style":1595},[1594],[383,16441,16443,16446],{"className":16442},[1581],[383,16444],{"className":16445,"style":1586},[1585],[383,16447,16406],{"className":16448},[1590],", it is classified as class 1.",[37,16451,16380,16452,16519],{},[383,16453,16455,16480],{"className":16454},[1545],[383,16456,16458],{"className":16457},[1549],[1551,16459,16460],{"xmlns":1553},[1555,16461,16462,16477],{},[1558,16463,16464,16466,16468,16470,16472,16475],{},[1938,16465,14062],{},[1565,16467,1933],{"stretchy":1929},[1938,16469,13603],{},[1565,16471,1955],{"stretchy":1929},[1565,16473,16474],{},"\u003C",[1561,16476,16406],{},[1569,16478,16479],{"encoding":1571},"\\sigma(z) \u003C 0.5",[383,16481,16483,16510],{"className":16482,"ariaHidden":1577},[1576],[383,16484,16486,16489,16492,16495,16498,16501,16504,16507],{"className":16485},[1581],[383,16487],{"className":16488,"style":2021},[1585],[383,16490,14062],{"className":16491,"style":2096},[1590,2033],[383,16493,1933],{"className":16494},[2025],[383,16496,13603],{"className":16497,"style":13677},[1590,2033],[383,16499,1955],{"className":16500},[2135],[383,16502],{"className":16503,"style":1595},[1594],[383,16505,16474],{"className":16506},[1599],[383,16508],{"className":16509,"style":1595},[1594],[383,16511,16513,16516],{"className":16512},[1581],[383,16514],{"className":16515,"style":1586},[1585],[383,16517,16406],{"className":16518},[1590],", it is classified as class 0.",[293,16521,16522,16525],{},[11,16523,16524],{},"Key properties:",[34,16526,16527,16530,16577],{},[37,16528,16529],{},"Bounded range between 0 and 1",[37,16531,16532,16533,16576],{},"Monotonicity: if z increases, ",[383,16534,16536,16555],{"className":16535},[1545],[383,16537,16539],{"className":16538},[1549],[1551,16540,16541],{"xmlns":1553},[1555,16542,16543,16553],{},[1558,16544,16545,16547,16549,16551],{},[1938,16546,14062],{},[1565,16548,1933],{"stretchy":1929},[1938,16550,13603],{},[1565,16552,1955],{"stretchy":1929},[1569,16554,16147],{"encoding":1571},[383,16556,16558],{"className":16557,"ariaHidden":1577},[1576],[383,16559,16561,16564,16567,16570,16573],{"className":16560},[1581],[383,16562],{"className":16563,"style":2021},[1585],[383,16565,14062],{"className":16566,"style":2096},[1590,2033],[383,16568,1933],{"className":16569},[2025],[383,16571,13603],{"className":16572,"style":13677},[1590,2033],[383,16574,1955],{"className":16575},[2135]," also increases",[37,16578,16579,16580,16646,16647,72,16699,16646,16765],{},"Asymptotic: ",[383,16581,16583,16607],{"className":16582},[1545],[383,16584,16586],{"className":16585},[1549],[1551,16587,16588],{"xmlns":1553},[1555,16589,16590,16604],{},[1558,16591,16592,16594,16596,16598,16600,16602],{},[1938,16593,14062],{},[1565,16595,1933],{"stretchy":1929},[1938,16597,13603],{},[1565,16599,1955],{"stretchy":1929},[1565,16601,2518],{},[1561,16603,1943],{},[1569,16605,16606],{"encoding":1571},"\\sigma(z) \\to 1",[383,16608,16610,16637],{"className":16609,"ariaHidden":1577},[1576],[383,16611,16613,16616,16619,16622,16625,16628,16631,16634],{"className":16612},[1581],[383,16614],{"className":16615,"style":2021},[1585],[383,16617,14062],{"className":16618,"style":2096},[1590,2033],[383,16620,1933],{"className":16621},[2025],[383,16623,13603],{"className":16624,"style":13677},[1590,2033],[383,16626,1955],{"className":16627},[2135],[383,16629],{"className":16630,"style":1595},[1594],[383,16632,2518],{"className":16633},[1599],[383,16635],{"className":16636,"style":1595},[1594],[383,16638,16640,16643],{"className":16639},[1581],[383,16641],{"className":16642,"style":1586},[1585],[383,16644,1943],{"className":16645},[1590]," when ",[383,16648,16650,16669],{"className":16649},[1545],[383,16651,16653],{"className":16652},[1549],[1551,16654,16655],{"xmlns":1553},[1555,16656,16657,16666],{},[1558,16658,16659,16661,16663],{},[1938,16660,13603],{},[1565,16662,2518],{},[1938,16664,16665],{"mathvariant":1980},"∞",[1569,16667,16668],{"encoding":1571},"z \\to \\infty",[383,16670,16672,16690],{"className":16671,"ariaHidden":1577},[1576],[383,16673,16675,16678,16681,16684,16687],{"className":16674},[1581],[383,16676],{"className":16677,"style":3364},[1585],[383,16679,13603],{"className":16680,"style":13677},[1590,2033],[383,16682],{"className":16683,"style":1595},[1594],[383,16685,2518],{"className":16686},[1599],[383,16688],{"className":16689,"style":1595},[1594],[383,16691,16693,16696],{"className":16692},[1581],[383,16694],{"className":16695,"style":3364},[1585],[383,16697,16665],{"className":16698},[1590],[383,16700,16702,16726],{"className":16701},[1545],[383,16703,16705],{"className":16704},[1549],[1551,16706,16707],{"xmlns":1553},[1555,16708,16709,16723],{},[1558,16710,16711,16713,16715,16717,16719,16721],{},[1938,16712,14062],{},[1565,16714,1933],{"stretchy":1929},[1938,16716,13603],{},[1565,16718,1955],{"stretchy":1929},[1565,16720,2518],{},[1561,16722,2913],{},[1569,16724,16725],{"encoding":1571},"\\sigma(z) \\to 0",[383,16727,16729,16756],{"className":16728,"ariaHidden":1577},[1576],[383,16730,16732,16735,16738,16741,16744,16747,16750,16753],{"className":16731},[1581],[383,16733],{"className":16734,"style":2021},[1585],[383,16736,14062],{"className":16737,"style":2096},[1590,2033],[383,16739,1933],{"className":16740},[2025],[383,16742,13603],{"className":16743,"style":13677},[1590,2033],[383,16745,1955],{"className":16746},[2135],[383,16748],{"className":16749,"style":1595},[1594],[383,16751,2518],{"className":16752},[1599],[383,16754],{"className":16755,"style":1595},[1594],[383,16757,16759,16762],{"className":16758},[1581],[383,16760],{"className":16761,"style":1586},[1585],[383,16763,2913],{"className":16764},[1590],[383,16766,16768,16788],{"className":16767},[1545],[383,16769,16771],{"className":16770},[1549],[1551,16772,16773],{"xmlns":1553},[1555,16774,16775,16785],{},[1558,16776,16777,16779,16781,16783],{},[1938,16778,13603],{},[1565,16780,2518],{},[1565,16782,1680],{},[1938,16784,16665],{"mathvariant":1980},[1569,16786,16787],{"encoding":1571},"z \\to -\\infty",[383,16789,16791,16809],{"className":16790,"ariaHidden":1577},[1576],[383,16792,16794,16797,16800,16803,16806],{"className":16793},[1581],[383,16795],{"className":16796,"style":3364},[1585],[383,16798,13603],{"className":16799,"style":13677},[1590,2033],[383,16801],{"className":16802,"style":1595},[1594],[383,16804,2518],{"className":16805},[1599],[383,16807],{"className":16808,"style":1595},[1594],[383,16810,16812,16815,16818],{"className":16811},[1581],[383,16813],{"className":16814,"style":3248},[1585],[383,16816,1680],{"className":16817},[1590],[383,16819,16665],{"className":16820},[1590],[11,16822,16823,16826,16827,16830,16831,1173],{},[40,16824,16825],{},"How do we measure error in classification?"," Here we use metrics like ",[40,16828,16829],{},"cross-entropy"," or ",[40,16832,16833],{},"log loss",[11,16835,16836],{},"Loss for a single sample:",[383,16838,16840],{"className":16839},[2494],[383,16841,16843,16921],{"className":16842},[1545],[383,16844,16846],{"className":16845},[1549],[1551,16847,16848],{"xmlns":1553,"display":2503},[1555,16849,16850,16918],{},[1558,16851,16852,16855,16857,16859,16862,16864,16867,16870,16873,16875,16881,16883,16885,16887,16889,16891,16893,16895,16897,16899,16901,16903,16905,16907,16913,16915],{},[1938,16853,16854],{},"L",[1565,16856,1567],{},[1565,16858,1680],{},[1565,16860,16861],{"stretchy":1929},"[",[1938,16863,1950],{},[1565,16865,16866],{},"⋅",[1938,16868,16869],{},"log",[1565,16871,16872],{},"⁡",[1565,16874,1933],{"stretchy":1929},[4422,16876,16877,16879],{"accent":1577},[1938,16878,1950],{},[1565,16880,4432],{},[1565,16882,1955],{"stretchy":1929},[1565,16884,2916],{},[1565,16886,1933],{"stretchy":1929},[1561,16888,1943],{},[1565,16890,1680],{},[1938,16892,1950],{},[1565,16894,1955],{"stretchy":1929},[1565,16896,16866],{},[1938,16898,16869],{},[1565,16900,16872],{},[1565,16902,1933],{"stretchy":1929},[1561,16904,1943],{},[1565,16906,1680],{},[4422,16908,16909,16911],{"accent":1577},[1938,16910,1950],{},[1565,16912,4432],{},[1565,16914,1955],{"stretchy":1929},[1565,16916,16917],{"stretchy":1929},"]",[1569,16919,16920],{"encoding":1571},"L = -[y \\cdot \\log(\\hat{y}) + (1 - y) \\cdot \\log(1 - \\hat{y})]",[383,16922,16924,16942,16966,17037,17058,17079,17105],{"className":16923,"ariaHidden":1577},[1576],[383,16925,16927,16930,16933,16936,16939],{"className":16926},[1581],[383,16928],{"className":16929,"style":2554},[1585],[383,16931,16854],{"className":16932},[1590,2033],[383,16934],{"className":16935,"style":1595},[1594],[383,16937,1567],{"className":16938},[1599],[383,16940],{"className":16941,"style":1595},[1594],[383,16943,16945,16948,16951,16954,16957,16960,16963],{"className":16944},[1581],[383,16946],{"className":16947,"style":2021},[1585],[383,16949,1680],{"className":16950},[1590],[383,16952,16861],{"className":16953},[2025],[383,16955,1950],{"className":16956,"style":2096},[1590,2033],[383,16958],{"className":16959,"style":2577},[1594],[383,16961,16866],{"className":16962},[3048],[383,16964],{"className":16965,"style":2577},[1594],[383,16967,16969,16972,16980,16983,17025,17028,17031,17034],{"className":16968},[1581],[383,16970],{"className":16971,"style":2021},[1585],[383,16973,16975,16976],{"className":16974},[5189],"lo",[383,16977,16979],{"style":16978},"margin-right:0.0139em;","g",[383,16981,1933],{"className":16982},[2025],[383,16984,16986],{"className":16985},[1590,4570],[383,16987,16989,17017],{"className":16988},[2041,2042],[383,16990,16992,17014],{"className":16991},[2046],[383,16993,16995,17003],{"className":16994,"style":5334},[2050],[383,16996,16997,17000],{"style":4583},[383,16998],{"className":16999,"style":4587},[2058],[383,17001,1950],{"className":17002,"style":2096},[1590,2033],[383,17004,17005,17008],{"style":4583},[383,17006],{"className":17007,"style":4587},[2058],[383,17009,17011],{"className":17010,"style":5636},[4637],[383,17012,4432],{"className":17013},[1590],[383,17015,2074],{"className":17016},[2073],[383,17018,17020],{"className":17019},[2046],[383,17021,17023],{"className":17022,"style":4651},[2050],[383,17024],{},[383,17026,1955],{"className":17027},[2135],[383,17029],{"className":17030,"style":2577},[1594],[383,17032,2916],{"className":17033},[3048],[383,17035],{"className":17036,"style":2577},[1594],[383,17038,17040,17043,17046,17049,17052,17055],{"className":17039},[1581],[383,17041],{"className":17042,"style":2021},[1585],[383,17044,1933],{"className":17045},[2025],[383,17047,1943],{"className":17048},[1590],[383,17050],{"className":17051,"style":2577},[1594],[383,17053,1680],{"className":17054},[3048],[383,17056],{"className":17057,"style":2577},[1594],[383,17059,17061,17064,17067,17070,17073,17076],{"className":17060},[1581],[383,17062],{"className":17063,"style":2021},[1585],[383,17065,1950],{"className":17066,"style":2096},[1590,2033],[383,17068,1955],{"className":17069},[2135],[383,17071],{"className":17072,"style":2577},[1594],[383,17074,16866],{"className":17075},[3048],[383,17077],{"className":17078,"style":2577},[1594],[383,17080,17082,17085,17090,17093,17096,17099,17102],{"className":17081},[1581],[383,17083],{"className":17084,"style":2021},[1585],[383,17086,16975,17088],{"className":17087},[5189],[383,17089,16979],{"style":16978},[383,17091,1933],{"className":17092},[2025],[383,17094,1943],{"className":17095},[1590],[383,17097],{"className":17098,"style":2577},[1594],[383,17100,1680],{"className":17101},[3048],[383,17103],{"className":17104,"style":2577},[1594],[383,17106,17108,17111,17153],{"className":17107},[1581],[383,17109],{"className":17110,"style":2021},[1585],[383,17112,17114],{"className":17113},[1590,4570],[383,17115,17117,17145],{"className":17116},[2041,2042],[383,17118,17120,17142],{"className":17119},[2046],[383,17121,17123,17131],{"className":17122,"style":5334},[2050],[383,17124,17125,17128],{"style":4583},[383,17126],{"className":17127,"style":4587},[2058],[383,17129,1950],{"className":17130,"style":2096},[1590,2033],[383,17132,17133,17136],{"style":4583},[383,17134],{"className":17135,"style":4587},[2058],[383,17137,17139],{"className":17138,"style":5636},[4637],[383,17140,4432],{"className":17141},[1590],[383,17143,2074],{"className":17144},[2073],[383,17146,17148],{"className":17147},[2046],[383,17149,17151],{"className":17150,"style":4651},[2050],[383,17152],{},[383,17154,17156],{"className":17155},[2135],")]",[11,17158,17159],{},"Average loss (or cost function) for the entire dataset:",[383,17161,17163],{"className":17162},[2494],[383,17164,17166,17275],{"className":17165},[1545],[383,17167,17169],{"className":17168},[1549],[1551,17170,17171],{"xmlns":1553,"display":2503},[1555,17172,17173,17272],{},[1558,17174,17175,17178,17180,17182,17188,17202,17204,17210,17212,17214,17216,17218,17228,17230,17232,17234,17236,17238,17244,17246,17248,17250,17252,17254,17256,17258,17268,17270],{},[1938,17176,17177],{},"J",[1565,17179,1567],{},[1565,17181,1680],{},[5025,17183,17184,17186],{},[1561,17185,1943],{},[1938,17187,1995],{},[5032,17189,17190,17192,17200],{},[1565,17191,5036],{},[1558,17193,17194,17196,17198],{},[1938,17195,2363],{},[1565,17197,1567],{},[1561,17199,1943],{},[1938,17201,1995],{},[1565,17203,16861],{"stretchy":1929},[1935,17205,17206,17208],{},[1938,17207,1950],{},[1938,17209,2363],{},[1565,17211,16866],{},[1938,17213,16869],{},[1565,17215,16872],{},[1565,17217,1933],{"stretchy":1929},[4422,17219,17220,17226],{"accent":1577},[1935,17221,17222,17224],{},[1938,17223,1950],{},[1938,17225,2363],{},[1565,17227,4432],{},[1565,17229,1955],{"stretchy":1929},[1565,17231,2916],{},[1565,17233,1933],{"stretchy":1929},[1561,17235,1943],{},[1565,17237,1680],{},[1935,17239,17240,17242],{},[1938,17241,1950],{},[1938,17243,2363],{},[1565,17245,1955],{"stretchy":1929},[1565,17247,16866],{},[1938,17249,16869],{},[1565,17251,16872],{},[1565,17253,1933],{"stretchy":1929},[1561,17255,1943],{},[1565,17257,1680],{},[4422,17259,17260,17266],{"accent":1577},[1935,17261,17262,17264],{},[1938,17263,1950],{},[1938,17265,2363],{},[1565,17267,4432],{},[1565,17269,1955],{"stretchy":1929},[1565,17271,16917],{"stretchy":1929},[1569,17273,17274],{"encoding":1571},"J = -\\frac{1}{n} \\sum_{i=1}^{n} [y_i \\cdot \\log(\\hat{y_i}) + (1 - y_i) \\cdot \\log(1 - \\hat{y_i})]",[383,17276,17278,17297,17490,17595,17616,17674,17700],{"className":17277,"ariaHidden":1577},[1576],[383,17279,17281,17284,17288,17291,17294],{"className":17280},[1581],[383,17282],{"className":17283,"style":2554},[1585],[383,17285,17177],{"className":17286,"style":17287},[1590,2033],"margin-right:0.0962em;",[383,17289],{"className":17290,"style":1595},[1594],[383,17292,1567],{"className":17293},[1599],[383,17295],{"className":17296,"style":1595},[1594],[383,17298,17300,17303,17306,17368,17371,17438,17441,17481,17484,17487],{"className":17299},[1581],[383,17301],{"className":17302,"style":5112},[1585],[383,17304,1680],{"className":17305},[1590],[383,17307,17309,17312,17365],{"className":17308},[1590],[383,17310],{"className":17311},[2025,5119],[383,17313,17315],{"className":17314},[5025],[383,17316,17318,17357],{"className":17317},[2041,2042],[383,17319,17321,17354],{"className":17320},[2046],[383,17322,17324,17335,17343],{"className":17323,"style":5132},[2050],[383,17325,17326,17329],{"style":5135},[383,17327],{"className":17328,"style":4587},[2058],[383,17330,17332],{"className":17331},[1590],[383,17333,1995],{"className":17334},[1590,2033],[383,17336,17337,17340],{"style":5147},[383,17338],{"className":17339,"style":4587},[2058],[383,17341],{"className":17342,"style":5155},[5154],[383,17344,17345,17348],{"style":5158},[383,17346],{"className":17347,"style":4587},[2058],[383,17349,17351],{"className":17350},[1590],[383,17352,1943],{"className":17353},[1590],[383,17355,2074],{"className":17356},[2073],[383,17358,17360],{"className":17359},[2046],[383,17361,17363],{"className":17362,"style":5177},[2050],[383,17364],{},[383,17366],{"className":17367},[2135,5119],[383,17369],{"className":17370,"style":1704},[1594],[383,17372,17374],{"className":17373},[5189,5190],[383,17375,17377,17430],{"className":17376},[2041,2042],[383,17378,17380,17427],{"className":17379},[2046],[383,17381,17383,17403,17413],{"className":17382,"style":5200},[2050],[383,17384,17385,17388],{"style":5203},[383,17386],{"className":17387,"style":5207},[2058],[383,17389,17391],{"className":17390},[2063,2064,2065,2066],[383,17392,17394,17397,17400],{"className":17393},[1590,2066],[383,17395,2363],{"className":17396},[1590,2033,2066],[383,17398,1567],{"className":17399},[1599,2066],[383,17401,1943],{"className":17402},[1590,2066],[383,17404,17405,17408],{"style":5225},[383,17406],{"className":17407,"style":5207},[2058],[383,17409,17410],{},[383,17411,5036],{"className":17412},[5189,5234,5235],[383,17414,17415,17418],{"style":5238},[383,17416],{"className":17417,"style":5207},[2058],[383,17419,17421],{"className":17420},[2063,2064,2065,2066],[383,17422,17424],{"className":17423},[1590,2066],[383,17425,1995],{"className":17426},[1590,2033,2066],[383,17428,2074],{"className":17429},[2073],[383,17431,17433],{"className":17432},[2046],[383,17434,17436],{"className":17435,"style":5260},[2050],[383,17437],{},[383,17439,16861],{"className":17440},[2025],[383,17442,17444,17447],{"className":17443},[1590],[383,17445,1950],{"className":17446,"style":2096},[1590,2033],[383,17448,17450],{"className":17449},[2037],[383,17451,17453,17473],{"className":17452},[2041,2042],[383,17454,17456,17470],{"className":17455},[2046],[383,17457,17459],{"className":17458,"style":2395},[2050],[383,17460,17461,17464],{"style":2111},[383,17462],{"className":17463,"style":2059},[2058],[383,17465,17467],{"className":17466},[2063,2064,2065,2066],[383,17468,2363],{"className":17469},[1590,2033,2066],[383,17471,2074],{"className":17472},[2073],[383,17474,17476],{"className":17475},[2046],[383,17477,17479],{"className":17478,"style":2081},[2050],[383,17480],{},[383,17482],{"className":17483,"style":2577},[1594],[383,17485,16866],{"className":17486},[3048],[383,17488],{"className":17489,"style":2577},[1594],[383,17491,17493,17496,17501,17504,17583,17586,17589,17592],{"className":17492},[1581],[383,17494],{"className":17495,"style":2021},[1585],[383,17497,16975,17499],{"className":17498},[5189],[383,17500,16979],{"style":16978},[383,17502,1933],{"className":17503},[2025],[383,17505,17507],{"className":17506},[1590,4570],[383,17508,17510,17575],{"className":17509},[2041,2042],[383,17511,17513,17572],{"className":17512},[2046],[383,17514,17516,17561],{"className":17515,"style":5334},[2050],[383,17517,17518,17521],{"style":4583},[383,17519],{"className":17520,"style":4587},[2058],[383,17522,17524,17527],{"className":17523},[1590],[383,17525,1950],{"className":17526,"style":2096},[1590,2033],[383,17528,17530],{"className":17529},[2037],[383,17531,17533,17553],{"className":17532},[2041,2042],[383,17534,17536,17550],{"className":17535},[2046],[383,17537,17539],{"className":17538,"style":2395},[2050],[383,17540,17541,17544],{"style":2111},[383,17542],{"className":17543,"style":2059},[2058],[383,17545,17547],{"className":17546},[2063,2064,2065,2066],[383,17548,2363],{"className":17549},[1590,2033,2066],[383,17551,2074],{"className":17552},[2073],[383,17554,17556],{"className":17555},[2046],[383,17557,17559],{"className":17558,"style":2081},[2050],[383,17560],{},[383,17562,17563,17566],{"style":4583},[383,17564],{"className":17565,"style":4587},[2058],[383,17567,17569],{"className":17568,"style":4638},[4637],[383,17570,4432],{"className":17571},[1590],[383,17573,2074],{"className":17574},[2073],[383,17576,17578],{"className":17577},[2046],[383,17579,17581],{"className":17580,"style":4651},[2050],[383,17582],{},[383,17584,1955],{"className":17585},[2135],[383,17587],{"className":17588,"style":2577},[1594],[383,17590,2916],{"className":17591},[3048],[383,17593],{"className":17594,"style":2577},[1594],[383,17596,17598,17601,17604,17607,17610,17613],{"className":17597},[1581],[383,17599],{"className":17600,"style":2021},[1585],[383,17602,1933],{"className":17603},[2025],[383,17605,1943],{"className":17606},[1590],[383,17608],{"className":17609,"style":2577},[1594],[383,17611,1680],{"className":17612},[3048],[383,17614],{"className":17615,"style":2577},[1594],[383,17617,17619,17622,17662,17665,17668,17671],{"className":17618},[1581],[383,17620],{"className":17621,"style":2021},[1585],[383,17623,17625,17628],{"className":17624},[1590],[383,17626,1950],{"className":17627,"style":2096},[1590,2033],[383,17629,17631],{"className":17630},[2037],[383,17632,17634,17654],{"className":17633},[2041,2042],[383,17635,17637,17651],{"className":17636},[2046],[383,17638,17640],{"className":17639,"style":2395},[2050],[383,17641,17642,17645],{"style":2111},[383,17643],{"className":17644,"style":2059},[2058],[383,17646,17648],{"className":17647},[2063,2064,2065,2066],[383,17649,2363],{"className":17650},[1590,2033,2066],[383,17652,2074],{"className":17653},[2073],[383,17655,17657],{"className":17656},[2046],[383,17658,17660],{"className":17659,"style":2081},[2050],[383,17661],{},[383,17663,1955],{"className":17664},[2135],[383,17666],{"className":17667,"style":2577},[1594],[383,17669,16866],{"className":17670},[3048],[383,17672],{"className":17673,"style":2577},[1594],[383,17675,17677,17680,17685,17688,17691,17694,17697],{"className":17676},[1581],[383,17678],{"className":17679,"style":2021},[1585],[383,17681,16975,17683],{"className":17682},[5189],[383,17684,16979],{"style":16978},[383,17686,1933],{"className":17687},[2025],[383,17689,1943],{"className":17690},[1590],[383,17692],{"className":17693,"style":2577},[1594],[383,17695,1680],{"className":17696},[3048],[383,17698],{"className":17699,"style":2577},[1594],[383,17701,17703,17706,17785],{"className":17702},[1581],[383,17704],{"className":17705,"style":2021},[1585],[383,17707,17709],{"className":17708},[1590,4570],[383,17710,17712,17777],{"className":17711},[2041,2042],[383,17713,17715,17774],{"className":17714},[2046],[383,17716,17718,17763],{"className":17717,"style":5334},[2050],[383,17719,17720,17723],{"style":4583},[383,17721],{"className":17722,"style":4587},[2058],[383,17724,17726,17729],{"className":17725},[1590],[383,17727,1950],{"className":17728,"style":2096},[1590,2033],[383,17730,17732],{"className":17731},[2037],[383,17733,17735,17755],{"className":17734},[2041,2042],[383,17736,17738,17752],{"className":17737},[2046],[383,17739,17741],{"className":17740,"style":2395},[2050],[383,17742,17743,17746],{"style":2111},[383,17744],{"className":17745,"style":2059},[2058],[383,17747,17749],{"className":17748},[2063,2064,2065,2066],[383,17750,2363],{"className":17751},[1590,2033,2066],[383,17753,2074],{"className":17754},[2073],[383,17756,17758],{"className":17757},[2046],[383,17759,17761],{"className":17760,"style":2081},[2050],[383,17762],{},[383,17764,17765,17768],{"style":4583},[383,17766],{"className":17767,"style":4587},[2058],[383,17769,17771],{"className":17770,"style":4638},[4637],[383,17772,4432],{"className":17773},[1590],[383,17775,2074],{"className":17776},[2073],[383,17778,17780],{"className":17779},[2046],[383,17781,17783],{"className":17782,"style":4651},[2050],[383,17784],{},[383,17786,17156],{"className":17787},[2135],[11,17789,3370],{},[34,17791,17792,17822,17922],{},[37,17793,17794,5467],{},[383,17795,17797,17810],{"className":17796},[1545],[383,17798,17800],{"className":17799},[1549],[1551,17801,17802],{"xmlns":1553},[1555,17803,17804,17808],{},[1558,17805,17806],{},[1938,17807,1995],{},[1569,17809,1995],{"encoding":1571},[383,17811,17813],{"className":17812,"ariaHidden":1577},[1576],[383,17814,17816,17819],{"className":17815},[1581],[383,17817],{"className":17818,"style":3364},[1585],[383,17820,1995],{"className":17821},[1590,2033],[37,17823,17824,17893,17894,1497],{},[383,17825,17827,17844],{"className":17826},[1545],[383,17828,17830],{"className":17829},[1549],[1551,17831,17832],{"xmlns":1553},[1555,17833,17834,17842],{},[1558,17835,17836],{},[1935,17837,17838,17840],{},[1938,17839,1950],{},[1938,17841,2363],{},[1569,17843,2439],{"encoding":1571},[383,17845,17847],{"className":17846,"ariaHidden":1577},[1576],[383,17848,17850,17853],{"className":17849},[1581],[383,17851],{"className":17852,"style":2449},[1585],[383,17854,17856,17859],{"className":17855},[1590],[383,17857,1950],{"className":17858,"style":2096},[1590,2033],[383,17860,17862],{"className":17861},[2037],[383,17863,17865,17885],{"className":17864},[2041,2042],[383,17866,17868,17882],{"className":17867},[2046],[383,17869,17871],{"className":17870,"style":2395},[2050],[383,17872,17873,17876],{"style":2111},[383,17874],{"className":17875,"style":2059},[2058],[383,17877,17879],{"className":17878},[2063,2064,2065,2066],[383,17880,2363],{"className":17881},[1590,2033,2066],[383,17883,2074],{"className":17884},[2073],[383,17886,17888],{"className":17887},[2046],[383,17889,17891],{"className":17890,"style":2081},[2050],[383,17892],{}," is the true label (0 or 1) for example ",[383,17895,17897,17910],{"className":17896},[1545],[383,17898,17900],{"className":17899},[1549],[1551,17901,17902],{"xmlns":1553},[1555,17903,17904,17908],{},[1558,17905,17906],{},[1938,17907,2363],{},[1569,17909,2363],{"encoding":1571},[383,17911,17913],{"className":17912,"ariaHidden":1577},[1576],[383,17914,17916,17919],{"className":17915},[1581],[383,17917],{"className":17918,"style":5565},[1585],[383,17920,2363],{"className":17921},[1590,2033],[37,17923,17924,18037,18038,18066],{},[383,17925,17927,17949],{"className":17926},[1545],[383,17928,17930],{"className":17929},[1549],[1551,17931,17932],{"xmlns":1553},[1555,17933,17934,17946],{},[1558,17935,17936],{},[4422,17937,17938,17944],{"accent":1577},[1935,17939,17940,17942],{},[1938,17941,1950],{},[1938,17943,2363],{},[1565,17945,4432],{},[1569,17947,17948],{"encoding":1571},"\\hat{y_i}",[383,17950,17952],{"className":17951,"ariaHidden":1577},[1576],[383,17953,17955,17958],{"className":17954},[1581],[383,17956],{"className":17957,"style":2534},[1585],[383,17959,17961],{"className":17960},[1590,4570],[383,17962,17964,18029],{"className":17963},[2041,2042],[383,17965,17967,18026],{"className":17966},[2046],[383,17968,17970,18015],{"className":17969,"style":5334},[2050],[383,17971,17972,17975],{"style":4583},[383,17973],{"className":17974,"style":4587},[2058],[383,17976,17978,17981],{"className":17977},[1590],[383,17979,1950],{"className":17980,"style":2096},[1590,2033],[383,17982,17984],{"className":17983},[2037],[383,17985,17987,18007],{"className":17986},[2041,2042],[383,17988,17990,18004],{"className":17989},[2046],[383,17991,17993],{"className":17992,"style":2395},[2050],[383,17994,17995,17998],{"style":2111},[383,17996],{"className":17997,"style":2059},[2058],[383,17999,18001],{"className":18000},[2063,2064,2065,2066],[383,18002,2363],{"className":18003},[1590,2033,2066],[383,18005,2074],{"className":18006},[2073],[383,18008,18010],{"className":18009},[2046],[383,18011,18013],{"className":18012,"style":2081},[2050],[383,18014],{},[383,18016,18017,18020],{"style":4583},[383,18018],{"className":18019,"style":4587},[2058],[383,18021,18023],{"className":18022,"style":4638},[4637],[383,18024,4432],{"className":18025},[1590],[383,18027,2074],{"className":18028},[2073],[383,18030,18032],{"className":18031},[2046],[383,18033,18035],{"className":18034,"style":4651},[2050],[383,18036],{}," is the predicted probability by the model for example ",[383,18039,18041,18054],{"className":18040},[1545],[383,18042,18044],{"className":18043},[1549],[1551,18045,18046],{"xmlns":1553},[1555,18047,18048,18052],{},[1558,18049,18050],{},[1938,18051,2363],{},[1569,18053,2363],{"encoding":1571},[383,18055,18057],{"className":18056,"ariaHidden":1577},[1576],[383,18058,18060,18063],{"className":18059},[1581],[383,18061],{"className":18062,"style":5565},[1585],[383,18064,2363],{"className":18065},[1590,2033]," (value between 0 and 1).",[11,18068,18069],{},"Why is cross-entropy used?",[1008,18071,18072,18075,18078],{},[37,18073,18074],{},"It penalizes incorrect predictions with high confidence more heavily.",[37,18076,18077],{},"It is a convex loss function, which makes optimization easier using methods like gradient descent.",[37,18079,18080],{},"It has a probabilistic interpretation, as it is based on the predicted probability by the model.",[11,18082,18083],{},"The behavior of the loss function is shown in the following graph:",[11,18085,18086,18090],{},[80,18087],{"alt":18088,"src":18089},"Cross-Entropy Loss Function Graph","\u002Fblog\u002Fmachine-learning-paradigms-and-mathematical-foundations\u002Fshared\u002Fcross-entropy.webp",[85,18091,18088],{},[11,18093,18094],{},"The function penalizes more heavily the incorrect predictions with high confidence, which is reflected in the shape of the curve.",[1008,18096,18097],{},[37,18098,18099],{},"When the true label is 1 (y=1) (blue line):",[34,18101,18102,18226,18301],{},[37,18103,18104,18105],{},"The formula simplifies to ",[383,18106,18108,18140],{"className":18107},[1545],[383,18109,18111],{"className":18110},[1549],[1551,18112,18113],{"xmlns":1553},[1555,18114,18115,18137],{},[1558,18116,18117,18119,18121,18123,18125,18127,18129,18135],{},[1938,18118,16854],{},[1565,18120,1567],{},[1565,18122,1680],{},[1938,18124,16869],{},[1565,18126,16872],{},[1565,18128,1933],{"stretchy":1929},[4422,18130,18131,18133],{"accent":1577},[1938,18132,1950],{},[1565,18134,4432],{},[1565,18136,1955],{"stretchy":1929},[1569,18138,18139],{"encoding":1571},"L = -\\log(\\hat{y})",[383,18141,18143,18161],{"className":18142,"ariaHidden":1577},[1576],[383,18144,18146,18149,18152,18155,18158],{"className":18145},[1581],[383,18147],{"className":18148,"style":2554},[1585],[383,18150,16854],{"className":18151},[1590,2033],[383,18153],{"className":18154,"style":1595},[1594],[383,18156,1567],{"className":18157},[1599],[383,18159],{"className":18160,"style":1595},[1594],[383,18162,18164,18167,18170,18173,18178,18181,18223],{"className":18163},[1581],[383,18165],{"className":18166,"style":2021},[1585],[383,18168,1680],{"className":18169},[1590],[383,18171],{"className":18172,"style":1704},[1594],[383,18174,16975,18176],{"className":18175},[5189],[383,18177,16979],{"style":16978},[383,18179,1933],{"className":18180},[2025],[383,18182,18184],{"className":18183},[1590,4570],[383,18185,18187,18215],{"className":18186},[2041,2042],[383,18188,18190,18212],{"className":18189},[2046],[383,18191,18193,18201],{"className":18192,"style":5334},[2050],[383,18194,18195,18198],{"style":4583},[383,18196],{"className":18197,"style":4587},[2058],[383,18199,1950],{"className":18200,"style":2096},[1590,2033],[383,18202,18203,18206],{"style":4583},[383,18204],{"className":18205,"style":4587},[2058],[383,18207,18209],{"className":18208,"style":5636},[4637],[383,18210,4432],{"className":18211},[1590],[383,18213,2074],{"className":18214},[2073],[383,18216,18218],{"className":18217},[2046],[383,18219,18221],{"className":18220,"style":4651},[2050],[383,18222],{},[383,18224,1955],{"className":18225},[2135],[37,18227,16380,18228,18300],{},[383,18229,18231,18249],{"className":18230},[1545],[383,18232,18234],{"className":18233},[1549],[1551,18235,18236],{"xmlns":1553},[1555,18237,18238,18246],{},[1558,18239,18240],{},[4422,18241,18242,18244],{"accent":1577},[1938,18243,1950],{},[1565,18245,4432],{},[1569,18247,18248],{"encoding":1571},"\\hat{y}",[383,18250,18252],{"className":18251,"ariaHidden":1577},[1576],[383,18253,18255,18258],{"className":18254},[1581],[383,18256],{"className":18257,"style":2534},[1585],[383,18259,18261],{"className":18260},[1590,4570],[383,18262,18264,18292],{"className":18263},[2041,2042],[383,18265,18267,18289],{"className":18266},[2046],[383,18268,18270,18278],{"className":18269,"style":5334},[2050],[383,18271,18272,18275],{"style":4583},[383,18273],{"className":18274,"style":4587},[2058],[383,18276,1950],{"className":18277,"style":2096},[1590,2033],[383,18279,18280,18283],{"style":4583},[383,18281],{"className":18282,"style":4587},[2058],[383,18284,18286],{"className":18285,"style":5636},[4637],[383,18287,4432],{"className":18288},[1590],[383,18290,2074],{"className":18291},[2073],[383,18293,18295],{"className":18294},[2046],[383,18296,18298],{"className":18297,"style":4651},[2050],[383,18299],{}," approaches 1, the loss approaches 0 (good prediction).",[37,18302,16380,18303,18374],{},[383,18304,18306,18323],{"className":18305},[1545],[383,18307,18309],{"className":18308},[1549],[1551,18310,18311],{"xmlns":1553},[1555,18312,18313,18321],{},[1558,18314,18315],{},[4422,18316,18317,18319],{"accent":1577},[1938,18318,1950],{},[1565,18320,4432],{},[1569,18322,18248],{"encoding":1571},[383,18324,18326],{"className":18325,"ariaHidden":1577},[1576],[383,18327,18329,18332],{"className":18328},[1581],[383,18330],{"className":18331,"style":2534},[1585],[383,18333,18335],{"className":18334},[1590,4570],[383,18336,18338,18366],{"className":18337},[2041,2042],[383,18339,18341,18363],{"className":18340},[2046],[383,18342,18344,18352],{"className":18343,"style":5334},[2050],[383,18345,18346,18349],{"style":4583},[383,18347],{"className":18348,"style":4587},[2058],[383,18350,1950],{"className":18351,"style":2096},[1590,2033],[383,18353,18354,18357],{"style":4583},[383,18355],{"className":18356,"style":4587},[2058],[383,18358,18360],{"className":18359,"style":5636},[4637],[383,18361,4432],{"className":18362},[1590],[383,18364,2074],{"className":18365},[2073],[383,18367,18369],{"className":18368},[2046],[383,18370,18372],{"className":18371,"style":4651},[2050],[383,18373],{}," approaches 0, the loss shoots to infinity (bad prediction).",[1008,18376,18377],{"start":1823},[37,18378,18379],{},"When the true label is 0 (y=0) (red line):",[34,18381,18382,18527,18601],{},[37,18383,18104,18384],{},[383,18385,18387,18423],{"className":18386},[1545],[383,18388,18390],{"className":18389},[1549],[1551,18391,18392],{"xmlns":1553},[1555,18393,18394,18420],{},[1558,18395,18396,18398,18400,18402,18404,18406,18408,18410,18412,18418],{},[1938,18397,16854],{},[1565,18399,1567],{},[1565,18401,1680],{},[1938,18403,16869],{},[1565,18405,16872],{},[1565,18407,1933],{"stretchy":1929},[1561,18409,1943],{},[1565,18411,1680],{},[4422,18413,18414,18416],{"accent":1577},[1938,18415,1950],{},[1565,18417,4432],{},[1565,18419,1955],{"stretchy":1929},[1569,18421,18422],{"encoding":1571},"L = -\\log(1 - \\hat{y})",[383,18424,18426,18444,18476],{"className":18425,"ariaHidden":1577},[1576],[383,18427,18429,18432,18435,18438,18441],{"className":18428},[1581],[383,18430],{"className":18431,"style":2554},[1585],[383,18433,16854],{"className":18434},[1590,2033],[383,18436],{"className":18437,"style":1595},[1594],[383,18439,1567],{"className":18440},[1599],[383,18442],{"className":18443,"style":1595},[1594],[383,18445,18447,18450,18453,18456,18461,18464,18467,18470,18473],{"className":18446},[1581],[383,18448],{"className":18449,"style":2021},[1585],[383,18451,1680],{"className":18452},[1590],[383,18454],{"className":18455,"style":1704},[1594],[383,18457,16975,18459],{"className":18458},[5189],[383,18460,16979],{"style":16978},[383,18462,1933],{"className":18463},[2025],[383,18465,1943],{"className":18466},[1590],[383,18468],{"className":18469,"style":2577},[1594],[383,18471,1680],{"className":18472},[3048],[383,18474],{"className":18475,"style":2577},[1594],[383,18477,18479,18482,18524],{"className":18478},[1581],[383,18480],{"className":18481,"style":2021},[1585],[383,18483,18485],{"className":18484},[1590,4570],[383,18486,18488,18516],{"className":18487},[2041,2042],[383,18489,18491,18513],{"className":18490},[2046],[383,18492,18494,18502],{"className":18493,"style":5334},[2050],[383,18495,18496,18499],{"style":4583},[383,18497],{"className":18498,"style":4587},[2058],[383,18500,1950],{"className":18501,"style":2096},[1590,2033],[383,18503,18504,18507],{"style":4583},[383,18505],{"className":18506,"style":4587},[2058],[383,18508,18510],{"className":18509,"style":5636},[4637],[383,18511,4432],{"className":18512},[1590],[383,18514,2074],{"className":18515},[2073],[383,18517,18519],{"className":18518},[2046],[383,18520,18522],{"className":18521,"style":4651},[2050],[383,18523],{},[383,18525,1955],{"className":18526},[2135],[37,18528,16380,18529,18600],{},[383,18530,18532,18549],{"className":18531},[1545],[383,18533,18535],{"className":18534},[1549],[1551,18536,18537],{"xmlns":1553},[1555,18538,18539,18547],{},[1558,18540,18541],{},[4422,18542,18543,18545],{"accent":1577},[1938,18544,1950],{},[1565,18546,4432],{},[1569,18548,18248],{"encoding":1571},[383,18550,18552],{"className":18551,"ariaHidden":1577},[1576],[383,18553,18555,18558],{"className":18554},[1581],[383,18556],{"className":18557,"style":2534},[1585],[383,18559,18561],{"className":18560},[1590,4570],[383,18562,18564,18592],{"className":18563},[2041,2042],[383,18565,18567,18589],{"className":18566},[2046],[383,18568,18570,18578],{"className":18569,"style":5334},[2050],[383,18571,18572,18575],{"style":4583},[383,18573],{"className":18574,"style":4587},[2058],[383,18576,1950],{"className":18577,"style":2096},[1590,2033],[383,18579,18580,18583],{"style":4583},[383,18581],{"className":18582,"style":4587},[2058],[383,18584,18586],{"className":18585,"style":5636},[4637],[383,18587,4432],{"className":18588},[1590],[383,18590,2074],{"className":18591},[2073],[383,18593,18595],{"className":18594},[2046],[383,18596,18598],{"className":18597,"style":4651},[2050],[383,18599],{}," approaches 0, the loss approaches 0 (good prediction).",[37,18602,16380,18603,18674],{},[383,18604,18606,18623],{"className":18605},[1545],[383,18607,18609],{"className":18608},[1549],[1551,18610,18611],{"xmlns":1553},[1555,18612,18613,18621],{},[1558,18614,18615],{},[4422,18616,18617,18619],{"accent":1577},[1938,18618,1950],{},[1565,18620,4432],{},[1569,18622,18248],{"encoding":1571},[383,18624,18626],{"className":18625,"ariaHidden":1577},[1576],[383,18627,18629,18632],{"className":18628},[1581],[383,18630],{"className":18631,"style":2534},[1585],[383,18633,18635],{"className":18634},[1590,4570],[383,18636,18638,18666],{"className":18637},[2041,2042],[383,18639,18641,18663],{"className":18640},[2046],[383,18642,18644,18652],{"className":18643,"style":5334},[2050],[383,18645,18646,18649],{"style":4583},[383,18647],{"className":18648,"style":4587},[2058],[383,18650,1950],{"className":18651,"style":2096},[1590,2033],[383,18653,18654,18657],{"style":4583},[383,18655],{"className":18656,"style":4587},[2058],[383,18658,18660],{"className":18659,"style":5636},[4637],[383,18661,4432],{"className":18662},[1590],[383,18664,2074],{"className":18665},[2073],[383,18667,18669],{"className":18668},[2046],[383,18670,18672],{"className":18671,"style":4651},[2050],[383,18673],{}," approaches 1, the loss shoots to infinity (bad prediction).",[11,18676,18677],{},"The logarithmic nature of the function ensures that the model is heavily penalized when it is \"confident but wrong\", forcing it to adjust its weights more aggressively to improve predictions.",[91,18679,18681],{"id":18680},"validation-and-optimization","Validation and Optimization",[299,18683,122],{"id":18684},"evaluation-metrics",[11,18686,18687,18688,18690],{},"For ",[40,18689,2880],{},", the common metrics include:",[34,18692,18693,18698,18704],{},[37,18694,18695,18697],{},[40,18696,814],{},": Average of the squares of the differences between the actual values and the predictions.",[37,18699,18700,18703],{},[40,18701,18702],{},"Root Mean Squared Error (RMSE)",": Square root of the MSE, which has the same unit as the dependent variable.",[37,18705,18706,18709],{},[40,18707,18708],{},"Coefficient of Determination (R²)",": Proportion of the variance in the dependent variable that is explained by the model.",[11,18711,18687,18712,18690],{},[40,18713,13288],{},[34,18715,18716,18722,18727,18732],{},[37,18717,18718,18721],{},[40,18719,18720],{},"Accuracy",": Proportion of correct predictions over the total number of examples.",[37,18723,18724,18726],{},[40,18725,790],{},": Proportion of true positives over the total number of positive predictions.",[37,18728,18729,18731],{},[40,18730,796],{},": Proportion of true positives over the total number of actual positive examples.",[37,18733,18734,18737],{},[40,18735,18736],{},"F1 Score",": Harmonic mean of precision and recall, providing a balanced measure between both.",[293,18739,18740],{},[11,18741,18742],{},"The choice of the appropriate metric depends on the context of the problem and the consequences of classification errors. For example, in a fraud detection problem, it is more important to minimize false negatives (failing to detect fraud) than false positives (marking a legitimate transaction as fraud), so recall could be a more relevant metric than precision.",[299,18744,18746],{"id":18745},"optimization","Optimization",[11,18748,18749,18750,18753],{},"Optimization of machine learning models refers to the process of adjusting the model parameters to ",[40,18751,18752],{},"minimize the loss function",". This can be achieved through techniques like gradient descent, which iteratively adjusts the model weights in the direction that reduces the loss.",[11,18755,18756],{},"Gradient descent can be mathematically expressed as:",[383,18758,18760],{"className":18759},[2494],[383,18761,18763,18798],{"className":18762},[1545],[383,18764,18766],{"className":18765},[1549],[1551,18767,18768],{"xmlns":1553,"display":2503},[1555,18769,18770,18795],{},[1558,18771,18772,18775,18777,18779,18781,18784,18787,18789,18791,18793],{},[1938,18773,18774],{},"θ",[1565,18776,1567],{},[1938,18778,18774],{},[1565,18780,1680],{},[1938,18782,18783],{},"α",[1938,18785,18786],{"mathvariant":1980},"∇",[1938,18788,17177],{},[1565,18790,1933],{"stretchy":1929},[1938,18792,18774],{},[1565,18794,1955],{"stretchy":1929},[1569,18796,18797],{"encoding":1571},"\\theta = \\theta - \\alpha \\nabla J(\\theta)",[383,18799,18801,18820,18839],{"className":18800,"ariaHidden":1577},[1576],[383,18802,18804,18807,18811,18814,18817],{"className":18803},[1581],[383,18805],{"className":18806,"style":5334},[1585],[383,18808,18774],{"className":18809,"style":18810},[1590,2033],"margin-right:0.0278em;",[383,18812],{"className":18813,"style":1595},[1594],[383,18815,1567],{"className":18816},[1599],[383,18818],{"className":18819,"style":1595},[1594],[383,18821,18823,18827,18830,18833,18836],{"className":18822},[1581],[383,18824],{"className":18825,"style":18826},[1585],"height:0.7778em;vertical-align:-0.0833em;",[383,18828,18774],{"className":18829,"style":18810},[1590,2033],[383,18831],{"className":18832,"style":2577},[1594],[383,18834,1680],{"className":18835},[3048],[383,18837],{"className":18838,"style":2577},[1594],[383,18840,18842,18845,18849,18852,18855,18858,18861],{"className":18841},[1581],[383,18843],{"className":18844,"style":2021},[1585],[383,18846,18783],{"className":18847,"style":18848},[1590,2033],"margin-right:0.0037em;",[383,18850,18786],{"className":18851},[1590],[383,18853,17177],{"className":18854,"style":17287},[1590,2033],[383,18856,1933],{"className":18857},[2025],[383,18859,18774],{"className":18860,"style":18810},[1590,2033],[383,18862,1955],{"className":18863},[2135],[11,18865,3370],{},[34,18867,18868,18900,18932],{},[37,18869,18870,18899],{},[383,18871,18873,18887],{"className":18872},[1545],[383,18874,18876],{"className":18875},[1549],[1551,18877,18878],{"xmlns":1553},[1555,18879,18880,18884],{},[1558,18881,18882],{},[1938,18883,18774],{},[1569,18885,18886],{"encoding":1571},"\\theta",[383,18888,18890],{"className":18889,"ariaHidden":1577},[1576],[383,18891,18893,18896],{"className":18892},[1581],[383,18894],{"className":18895,"style":5334},[1585],[383,18897,18774],{"className":18898,"style":18810},[1590,2033]," represents the model parameters (for example, the coefficients in regression).",[37,18901,18902,18931],{},[383,18903,18905,18919],{"className":18904},[1545],[383,18906,18908],{"className":18907},[1549],[1551,18909,18910],{"xmlns":1553},[1555,18911,18912,18916],{},[1558,18913,18914],{},[1938,18915,18783],{},[1569,18917,18918],{"encoding":1571},"\\alpha",[383,18920,18922],{"className":18921,"ariaHidden":1577},[1576],[383,18923,18925,18928],{"className":18924},[1581],[383,18926],{"className":18927,"style":3364},[1585],[383,18929,18783],{"className":18930,"style":18848},[1590,2033]," is the learning rate, which controls the size of the steps taken in each iteration.",[37,18933,18934,18983],{},[383,18935,18937,18959],{"className":18936},[1545],[383,18938,18940],{"className":18939},[1549],[1551,18941,18942],{"xmlns":1553},[1555,18943,18944,18956],{},[1558,18945,18946,18948,18950,18952,18954],{},[1938,18947,18786],{"mathvariant":1980},[1938,18949,17177],{},[1565,18951,1933],{"stretchy":1929},[1938,18953,18774],{},[1565,18955,1955],{"stretchy":1929},[1569,18957,18958],{"encoding":1571},"\\nabla J(\\theta)",[383,18960,18962],{"className":18961,"ariaHidden":1577},[1576],[383,18963,18965,18968,18971,18974,18977,18980],{"className":18964},[1581],[383,18966],{"className":18967,"style":2021},[1585],[383,18969,18786],{"className":18970},[1590],[383,18972,17177],{"className":18973,"style":17287},[1590,2033],[383,18975,1933],{"className":18976},[2025],[383,18978,18774],{"className":18979,"style":18810},[1590,2033],[383,18981,1955],{"className":18982},[2135]," is the gradient of the loss function with respect to the parameters, indicating the direction of greatest increase in the loss.",[11,18985,18986],{},"The optimization process continues until a convergence criterion is met, such as a maximum number of iterations or a minimum improvement in the loss function.",[34,18988,18989,19025,19079],{},[37,18990,18991,18992,18995,18996,19024],{},"It has a ",[40,18993,18994],{},"learning rate"," (",[383,18997,18999,19012],{"className":18998},[1545],[383,19000,19002],{"className":19001},[1549],[1551,19003,19004],{"xmlns":1553},[1555,19005,19006,19010],{},[1558,19007,19008],{},[1938,19009,18783],{},[1569,19011,18918],{"encoding":1571},[383,19013,19015],{"className":19014,"ariaHidden":1577},[1576],[383,19016,19018,19021],{"className":19017},[1581],[383,19019],{"className":19020,"style":3364},[1585],[383,19022,18783],{"className":19023,"style":18848},[1590,2033],") that controls the size of the steps taken in each iteration (typically a small value like 0.01 or 0.001).",[37,19026,4057,19027,18995,19030,19078],{},[40,19028,19029],{},"gradient",[383,19031,19033,19054],{"className":19032},[1545],[383,19034,19036],{"className":19035},[1549],[1551,19037,19038],{"xmlns":1553},[1555,19039,19040,19052],{},[1558,19041,19042,19044,19046,19048,19050],{},[1938,19043,18786],{"mathvariant":1980},[1938,19045,17177],{},[1565,19047,1933],{"stretchy":1929},[1938,19049,18774],{},[1565,19051,1955],{"stretchy":1929},[1569,19053,18958],{"encoding":1571},[383,19055,19057],{"className":19056,"ariaHidden":1577},[1576],[383,19058,19060,19063,19066,19069,19072,19075],{"className":19059},[1581],[383,19061],{"className":19062,"style":2021},[1585],[383,19064,18786],{"className":19065},[1590],[383,19067,17177],{"className":19068,"style":17287},[1590,2033],[383,19070,1933],{"className":19071},[2025],[383,19073,18774],{"className":19074,"style":18810},[1590,2033],[383,19076,1955],{"className":19077},[2135],") is a vector containing the partial derivatives of the loss function with respect to each parameter, indicating the direction of greatest increase in the loss.",[37,19080,19081,19082,19085],{},"The optimization process continues until a ",[40,19083,19084],{},"convergence"," criterion is met, such as a maximum number of iterations or a minimum improvement in the loss function.",[11,19087,19088],{},"Graphically:",[11,19090,19091,19095],{},[80,19092],{"alt":19093,"src":19094},"Graphical representation of the gradient descent optimization process","\u002Fblog\u002Fmachine-learning-paradigms-and-mathematical-foundations\u002Fshared\u002Fgradient-descent.webp",[85,19096,19097],{},"Optimization with Gradient Descent",[1008,19099,19100,19103,19106,19109],{},[37,19101,19102],{},"The process starts with a random point on the loss function (INITIAL POINT).",[37,19104,19105],{},"The gradient is calculated at that point, indicating the direction of greatest increase in the loss.",[37,19107,19108],{},"The model parameters are updated in the opposite direction of the gradient, with a step size controlled by the learning rate (LEARNING RATE \u002F STEP SIZE).",[37,19110,19111],{},"This process is repeated iteratively until a local or global minimum of the loss function is reached, indicating that the model has been optimized.",[11,19113,19114],{},"The learning rate is crucial for the success of the optimization process:",[34,19116,19117,19127,19136],{},[37,19118,19119,19122,19123,19126],{},[40,19120,19121],{},"DIVERGENCE",": If the learning rate is too ",[40,19124,19125],{},"high",", the model may diverge, jumping over the minimum and increasing the loss.",[37,19128,19129,19122,19132,19135],{},[40,19130,19131],{},"SLOW CONVERGENCE",[40,19133,19134],{},"low",", the optimization process may be very slow, taking a long time to converge or getting stuck in a local minimum.",[37,19137,19138,19141],{},[40,19139,19140],{},"OPTIMAL CONVERGENCE",": An appropriate learning rate allows the model to converge efficiently towards a global or local minimum, effectively optimizing the loss function.",[91,19143,19145],{"id":19144},"the-machine-learning-process","The Machine Learning Process",[11,19147,19148],{},"We can summarize the ML process in:",[1008,19150,19151,19162,19173,19184,19194],{},[37,19152,19153,19156,19157],{},[40,19154,19155],{},"Learning Paradigm",": Choose the type of learning (supervised, unsupervised, reinforcement) based on the problem to solve.\n",[34,19158,19159],{},[37,19160,19161],{},"Define the type of problem and available data.",[37,19163,19164,19167,19168],{},[40,19165,19166],{},"Mathematical Model",": Select an appropriate model (regression, classification, clustering) and understand its mathematical formulation.\n",[34,19169,19170],{},[37,19171,19172],{},"Establish the mathematical relationship between input and output.",[37,19174,19175,19178,19179],{},[40,19176,19177],{},"Loss\u002FCost Function",": Define a loss function that measures the model's error and can be optimized.\n",[34,19180,19181],{},[37,19182,19183],{},"Quantifies how bad the model is in its predictions.",[37,19185,19186,19188,19189],{},[40,19187,18746],{},": Use techniques like gradient descent to adjust the model parameters and minimize the loss function.\n",[34,19190,19191],{},[37,19192,19193],{},"Finds the best parameters for the model to make good predictions.",[37,19195,19196,19198,19199],{},[40,19197,1501],{},": Measure the model's performance using appropriate metrics for the problem type (MSE for regression, accuracy\u002Frecall for classification, etc.).\n",[34,19200,19201],{},[37,19202,19203],{},"Validates the performance of the model and its ability to generalize to unseen data.",{"title":451,"searchDepth":1820,"depth":1820,"links":19205},[19206,19211,19215,19219],{"id":1900,"depth":1823,"text":1901,"children":19207},[19208,19209,19210],{"id":1907,"depth":1820,"text":1908},{"id":2599,"depth":1820,"text":2600},{"id":2828,"depth":1820,"text":2829},{"id":2866,"depth":1823,"text":2867,"children":19212},[19213,19214],{"id":2880,"depth":1820,"text":2593},{"id":13288,"depth":1820,"text":2587},{"id":18680,"depth":1823,"text":18681,"children":19216},[19217,19218],{"id":18684,"depth":1820,"text":122},{"id":18745,"depth":1820,"text":18746},{"id":19144,"depth":1823,"text":19145},"2026-04-06","\u002Fblog\u002Fmachine-learning-paradigms-and-mathematical-foundations\u002Fshared\u002Fml-paradigms.webp",{},"\u002Fblog\u002Fblog\u002Fmachine-learning-paradigms-and-mathematical-foundations",{"title":1881,"description":1886},{"loc":19226,"priority":1868,"lastmod":19220},"\u002Fes\u002Fblog\u002Fmachine-learning-paradigms-and-mathematical-foundations","machine-learning-paradigms-and-mathematical-foundations","blog\u002Fblog\u002Fmachine-learning-paradigms-and-mathematical-foundations","Types of machine learning, common algorithms and essential mathematical foundations for understanding how machine learning models work.",[1873,19231,272,1874,1873],"Artificial Intelligence","UebnJOgy7GPnhDI7uhV4sfkeLEvIHGR5vGNjmPhJxHE",{"id":19234,"title":19235,"author":6,"body":19236,"date":22953,"description":19240,"extension":1859,"image":22954,"lastmod":22953,"meta":22955,"navigation":1862,"order":19354,"path":22956,"seo":22957,"sitemap":22958,"slug":22960,"stem":22961,"summary":22962,"tags":22963,"__hash__":22969},"content_en\u002Fblog\u002Fblog\u002Fexperimenting-with-exploratory-data-analysis.md","Experimenting with Exploratory Data Analysis",{"type":8,"value":19237,"toc":22944},[19238,19241,19248,19250,19252,19256,19263,19271,19275,19290,20035,20039,20050,20102,20105,20227,20230,20265,20268,20272,20275,20295,20746,20755,20762,20767,20770,20773,20784,20791,20796,20810,20813,20826,20829,20840,20843,20854,20863,20866,20873,20879,20882,20889,20895,20902,20905,20908,20922,20925,20930,20933,20940,20943,20946,20957,20963,20965,20970,20984,20987,20994,20997,21186,21189,21192,21468,21471,21482,21491,21494,21514,21521,21527,21530,21536,21539,21561,21568,21619,21626,21670,21677,21715,21722,21754,21761,21764,21802,21805,21819,21824,21827,21833,21836,21839,21842,21850,21853,21856,21859,21879,21898,21902,21909,22199,22203,22206,22359,22362,22368,22374,22439,22442,22468,22473,22657,22666,22669,22672,22778,22781,22845,22848,22893,22896,22940],[11,19239,19240],{},"The exploratory data analysis (EDA) is a crucial step in any machine learning project. In this article, we will conduct some experiments with EDA to better understand how we can use it to gain valuable insights from our data and improve the performance of our models.",[11,19242,16,19243],{},[18,19244,19247],{"href":19245,"rel":19246},"https:\u002F\u002Fderas.dev\u002Fblog\u002Fworkflow-machine-learning-projects",[22],"The Workflow in Machine Learning Projects",[25,19249],{},[28,19251],{},[91,19253,19255],{"id":19254},"a-practical-exercise-estimating-café-sales","A Practical Exercise: Estimating Café Sales",[11,19257,19258,19259,19262],{},"To understand the true impact of Exploratory Data Analysis (EDA), let's move beyond theory and dive into practice with a commercial scenario: ",[40,19260,19261],{},"Estimate the monthly revenue a café will generate",". This type of exercise allows managers and business owners to make data-driven decisions rather than relying on gut feelings.",[11,19264,19265,19266],{},"You can follow this interactive exercise in Google Colab: ",[18,19267,19270],{"href":19268,"rel":19269},"https:\u002F\u002Fcolab.research.google.com\u002Fdrive\u002F12NPwGTp9JE0Vl926_ODlqpDRLkbnJimz?usp=sharing",[22],"EDA for Estimating Café Sales",[299,19272,19274],{"id":19273},"step-1-data-generation-and-loading","Step 1: Data Generation and Loading",[11,19276,19277,19278,19281,19282,19285,19286,19289],{},"As the first step, we need a historical dataset. We will simulate the data for 365 operational days of the café, with variables ranging from ambient temperature to advertising investment (Ads on social media). We import the essential tools from the classic Python stack: ",[404,19279,19280],{},"pandas"," for handling tables, and ",[404,19283,19284],{},"matplotlib","\u002F",[404,19287,19288],{},"seaborn"," for visualizations.",[443,19291,19295],{"className":19292,"code":19293,"language":19294,"meta":451,"style":451},"language-python shiki shiki-themes vitesse-light vitesse-dark","import pandas as pd\nimport numpy as np\nimport random\nimport matplotlib.pyplot as plt\nimport seaborn as sns\n\nnp.random.seed(42)\nrandom.seed(42)\n\nn = 365\nweathers = [\"Sunny\", \"Rainy\", \"Cloudy\"]\ndata = []\n\nfor _ in range(n):\n    temperature = round(random.uniform(15.0, 35.0), 1)\n    ad_investment = round(random.uniform(10.0, 150.0), 2)\n    nearby_events = random.choice([0, 1])\n    applied_discount = random.choice([0, 10, 15, 20])\n    weather = random.choice(weathers)\n\n    sales = (\n        500 +\n        (ad_investment * 2.5) -\n        (temperature * 8) +\n        (nearby_events * 250) +\n        (applied_discount * 5)\n    )\n\n    if weather == \"Rainy\": sales += 150\n    elif weather == \"Sunny\": sales -= 50\n\n    sales += np.random.normal(0, 80)\n\n    data.append([temperature, ad_investment, nearby_events, applied_discount, weather, round(sales, 2)])\n\ncolumns = [\"temperature_c\", \"ad_investment\", \"local_event\", \"discount\", \"weather\", \"daily_sales\"]\ndf = pd.DataFrame(data, columns=columns)\ndf.head()\n","python",[404,19296,19297,19315,19327,19334,19352,19365,19371,19396,19411,19416,19427,19470,19481,19486,19509,19547,19582,19610,19645,19666,19671,19682,19692,19712,19729,19746,19761,19767,19772,19801,19827,19832,19861,19866,19918,19923,19987,20021],{"__ignoreMap":451},[383,19298,19301,19305,19309,19312],{"class":19299,"line":19300},"line",1,[383,19302,19304],{"class":19303},"sTPum","import",[383,19306,19308],{"class":19307},"s8w-G"," pandas ",[383,19310,19311],{"class":19303},"as",[383,19313,19314],{"class":19307}," pd\n",[383,19316,19317,19319,19322,19324],{"class":19299,"line":1823},[383,19318,19304],{"class":19303},[383,19320,19321],{"class":19307}," numpy ",[383,19323,19311],{"class":19303},[383,19325,19326],{"class":19307}," np\n",[383,19328,19329,19331],{"class":19299,"line":1820},[383,19330,19304],{"class":19303},[383,19332,19333],{"class":19307}," random\n",[383,19335,19336,19338,19341,19344,19347,19349],{"class":19299,"line":1863},[383,19337,19304],{"class":19303},[383,19339,19340],{"class":19307}," matplotlib",[383,19342,1497],{"class":19343},"si6no",[383,19345,19346],{"class":19307},"pyplot ",[383,19348,19311],{"class":19303},[383,19350,19351],{"class":19307}," plt\n",[383,19353,19355,19357,19360,19362],{"class":19299,"line":19354},5,[383,19356,19304],{"class":19303},[383,19358,19359],{"class":19307}," seaborn ",[383,19361,19311],{"class":19303},[383,19363,19364],{"class":19307}," sns\n",[383,19366,19368],{"class":19299,"line":19367},6,[383,19369,19370],{"emptyLinePlaceholder":1862},"\n",[383,19372,19374,19377,19379,19382,19384,19387,19389,19393],{"class":19299,"line":19373},7,[383,19375,19376],{"class":19307},"np",[383,19378,1497],{"class":19343},[383,19380,19381],{"class":19307},"random",[383,19383,1497],{"class":19343},[383,19385,19386],{"class":19307},"seed",[383,19388,1933],{"class":19343},[383,19390,19392],{"class":19391},"sqbOQ","42",[383,19394,19395],{"class":19343},")\n",[383,19397,19399,19401,19403,19405,19407,19409],{"class":19299,"line":19398},8,[383,19400,19381],{"class":19307},[383,19402,1497],{"class":19343},[383,19404,19386],{"class":19307},[383,19406,1933],{"class":19343},[383,19408,19392],{"class":19391},[383,19410,19395],{"class":19343},[383,19412,19414],{"class":19299,"line":19413},9,[383,19415,19370],{"emptyLinePlaceholder":1862},[383,19417,19419,19422,19424],{"class":19299,"line":19418},10,[383,19420,19421],{"class":19307},"n ",[383,19423,1567],{"class":19343},[383,19425,19426],{"class":19391}," 365\n",[383,19428,19430,19433,19435,19438,19442,19446,19448,19450,19453,19456,19458,19460,19462,19465,19467],{"class":19299,"line":19429},11,[383,19431,19432],{"class":19307},"weathers ",[383,19434,1567],{"class":19343},[383,19436,19437],{"class":19343}," [",[383,19439,19441],{"class":19440},"scnC2","\"",[383,19443,19445],{"class":19444},"spP0B","Sunny",[383,19447,19441],{"class":19440},[383,19449,1674],{"class":19343},[383,19451,19452],{"class":19440}," \"",[383,19454,19455],{"class":19444},"Rainy",[383,19457,19441],{"class":19440},[383,19459,1674],{"class":19343},[383,19461,19452],{"class":19440},[383,19463,19464],{"class":19444},"Cloudy",[383,19466,19441],{"class":19440},[383,19468,19469],{"class":19343},"]\n",[383,19471,19473,19476,19478],{"class":19299,"line":19472},12,[383,19474,19475],{"class":19307},"data ",[383,19477,1567],{"class":19343},[383,19479,19480],{"class":19343}," []\n",[383,19482,19484],{"class":19299,"line":19483},13,[383,19485,19370],{"emptyLinePlaceholder":1862},[383,19487,19489,19492,19495,19498,19502,19504,19506],{"class":19299,"line":19488},14,[383,19490,19491],{"class":19303},"for",[383,19493,19494],{"class":19307}," _ ",[383,19496,19497],{"class":19303},"in",[383,19499,19501],{"class":19500},"sHLBJ"," range",[383,19503,1933],{"class":19343},[383,19505,1995],{"class":19307},[383,19507,19508],{"class":19343},"):\n",[383,19510,19512,19515,19517,19520,19522,19524,19526,19529,19531,19534,19536,19539,19542,19545],{"class":19299,"line":19511},15,[383,19513,19514],{"class":19307},"    temperature ",[383,19516,1567],{"class":19343},[383,19518,19519],{"class":19500}," round",[383,19521,1933],{"class":19343},[383,19523,19381],{"class":19307},[383,19525,1497],{"class":19343},[383,19527,19528],{"class":19307},"uniform",[383,19530,1933],{"class":19343},[383,19532,19533],{"class":19391},"15.0",[383,19535,1674],{"class":19343},[383,19537,19538],{"class":19391}," 35.0",[383,19540,19541],{"class":19343},"),",[383,19543,19544],{"class":19391}," 1",[383,19546,19395],{"class":19343},[383,19548,19550,19553,19555,19557,19559,19561,19563,19565,19567,19570,19572,19575,19577,19580],{"class":19299,"line":19549},16,[383,19551,19552],{"class":19307},"    ad_investment ",[383,19554,1567],{"class":19343},[383,19556,19519],{"class":19500},[383,19558,1933],{"class":19343},[383,19560,19381],{"class":19307},[383,19562,1497],{"class":19343},[383,19564,19528],{"class":19307},[383,19566,1933],{"class":19343},[383,19568,19569],{"class":19391},"10.0",[383,19571,1674],{"class":19343},[383,19573,19574],{"class":19391}," 150.0",[383,19576,19541],{"class":19343},[383,19578,19579],{"class":19391}," 2",[383,19581,19395],{"class":19343},[383,19583,19585,19588,19590,19593,19595,19598,19601,19603,19605,19607],{"class":19299,"line":19584},17,[383,19586,19587],{"class":19307},"    nearby_events ",[383,19589,1567],{"class":19343},[383,19591,19592],{"class":19307}," random",[383,19594,1497],{"class":19343},[383,19596,19597],{"class":19307},"choice",[383,19599,19600],{"class":19343},"([",[383,19602,2913],{"class":19391},[383,19604,1674],{"class":19343},[383,19606,19544],{"class":19391},[383,19608,19609],{"class":19343},"])\n",[383,19611,19613,19616,19618,19620,19622,19624,19626,19628,19630,19633,19635,19638,19640,19643],{"class":19299,"line":19612},18,[383,19614,19615],{"class":19307},"    applied_discount ",[383,19617,1567],{"class":19343},[383,19619,19592],{"class":19307},[383,19621,1497],{"class":19343},[383,19623,19597],{"class":19307},[383,19625,19600],{"class":19343},[383,19627,2913],{"class":19391},[383,19629,1674],{"class":19343},[383,19631,19632],{"class":19391}," 10",[383,19634,1674],{"class":19343},[383,19636,19637],{"class":19391}," 15",[383,19639,1674],{"class":19343},[383,19641,19642],{"class":19391}," 20",[383,19644,19609],{"class":19343},[383,19646,19648,19651,19653,19655,19657,19659,19661,19664],{"class":19299,"line":19647},19,[383,19649,19650],{"class":19307},"    weather ",[383,19652,1567],{"class":19343},[383,19654,19592],{"class":19307},[383,19656,1497],{"class":19343},[383,19658,19597],{"class":19307},[383,19660,1933],{"class":19343},[383,19662,19663],{"class":19307},"weathers",[383,19665,19395],{"class":19343},[383,19667,19669],{"class":19299,"line":19668},20,[383,19670,19370],{"emptyLinePlaceholder":1862},[383,19672,19674,19677,19679],{"class":19299,"line":19673},21,[383,19675,19676],{"class":19307},"    sales ",[383,19678,1567],{"class":19343},[383,19680,19681],{"class":19343}," (\n",[383,19683,19685,19688],{"class":19299,"line":19684},22,[383,19686,19687],{"class":19391},"        500",[383,19689,19691],{"class":19690},"s5TCs"," +\n",[383,19693,19695,19698,19701,19704,19707,19709],{"class":19299,"line":19694},23,[383,19696,19697],{"class":19343},"        (",[383,19699,19700],{"class":19307},"ad_investment ",[383,19702,19703],{"class":19690},"*",[383,19705,19706],{"class":19391}," 2.5",[383,19708,1955],{"class":19343},[383,19710,19711],{"class":19690}," -\n",[383,19713,19715,19717,19720,19722,19725,19727],{"class":19299,"line":19714},24,[383,19716,19697],{"class":19343},[383,19718,19719],{"class":19307},"temperature ",[383,19721,19703],{"class":19690},[383,19723,19724],{"class":19391}," 8",[383,19726,1955],{"class":19343},[383,19728,19691],{"class":19690},[383,19730,19732,19734,19737,19739,19742,19744],{"class":19299,"line":19731},25,[383,19733,19697],{"class":19343},[383,19735,19736],{"class":19307},"nearby_events ",[383,19738,19703],{"class":19690},[383,19740,19741],{"class":19391}," 250",[383,19743,1955],{"class":19343},[383,19745,19691],{"class":19690},[383,19747,19749,19751,19754,19756,19759],{"class":19299,"line":19748},26,[383,19750,19697],{"class":19343},[383,19752,19753],{"class":19307},"applied_discount ",[383,19755,19703],{"class":19690},[383,19757,19758],{"class":19391}," 5",[383,19760,19395],{"class":19343},[383,19762,19764],{"class":19299,"line":19763},27,[383,19765,19766],{"class":19343},"    )\n",[383,19768,19770],{"class":19299,"line":19769},28,[383,19771,19370],{"emptyLinePlaceholder":1862},[383,19773,19775,19778,19781,19784,19786,19788,19790,19792,19795,19798],{"class":19299,"line":19774},29,[383,19776,19777],{"class":19303},"    if",[383,19779,19780],{"class":19307}," weather ",[383,19782,19783],{"class":19690},"==",[383,19785,19452],{"class":19440},[383,19787,19455],{"class":19444},[383,19789,19441],{"class":19440},[383,19791,1173],{"class":19343},[383,19793,19794],{"class":19307}," sales ",[383,19796,19797],{"class":19343},"+=",[383,19799,19800],{"class":19391}," 150\n",[383,19802,19804,19807,19809,19811,19813,19815,19817,19819,19821,19824],{"class":19299,"line":19803},30,[383,19805,19806],{"class":19303},"    elif",[383,19808,19780],{"class":19307},[383,19810,19783],{"class":19690},[383,19812,19452],{"class":19440},[383,19814,19445],{"class":19444},[383,19816,19441],{"class":19440},[383,19818,1173],{"class":19343},[383,19820,19794],{"class":19307},[383,19822,19823],{"class":19343},"-=",[383,19825,19826],{"class":19391}," 50\n",[383,19828,19830],{"class":19299,"line":19829},31,[383,19831,19370],{"emptyLinePlaceholder":1862},[383,19833,19835,19837,19839,19842,19844,19846,19848,19850,19852,19854,19856,19859],{"class":19299,"line":19834},32,[383,19836,19676],{"class":19307},[383,19838,19797],{"class":19343},[383,19840,19841],{"class":19307}," np",[383,19843,1497],{"class":19343},[383,19845,19381],{"class":19307},[383,19847,1497],{"class":19343},[383,19849,1980],{"class":19307},[383,19851,1933],{"class":19343},[383,19853,2913],{"class":19391},[383,19855,1674],{"class":19343},[383,19857,19858],{"class":19391}," 80",[383,19860,19395],{"class":19343},[383,19862,19864],{"class":19299,"line":19863},33,[383,19865,19370],{"emptyLinePlaceholder":1862},[383,19867,19869,19872,19874,19877,19879,19882,19884,19887,19889,19892,19894,19897,19899,19902,19904,19906,19908,19911,19913,19915],{"class":19299,"line":19868},34,[383,19870,19871],{"class":19307},"    data",[383,19873,1497],{"class":19343},[383,19875,19876],{"class":19307},"append",[383,19878,19600],{"class":19343},[383,19880,19881],{"class":19307},"temperature",[383,19883,1674],{"class":19343},[383,19885,19886],{"class":19307}," ad_investment",[383,19888,1674],{"class":19343},[383,19890,19891],{"class":19307}," nearby_events",[383,19893,1674],{"class":19343},[383,19895,19896],{"class":19307}," applied_discount",[383,19898,1674],{"class":19343},[383,19900,19901],{"class":19307}," weather",[383,19903,1674],{"class":19343},[383,19905,19519],{"class":19500},[383,19907,1933],{"class":19343},[383,19909,19910],{"class":19307},"sales",[383,19912,1674],{"class":19343},[383,19914,19579],{"class":19391},[383,19916,19917],{"class":19343},")])\n",[383,19919,19921],{"class":19299,"line":19920},35,[383,19922,19370],{"emptyLinePlaceholder":1862},[383,19924,19926,19929,19931,19933,19935,19938,19940,19942,19944,19947,19949,19951,19953,19956,19958,19960,19962,19965,19967,19969,19971,19974,19976,19978,19980,19983,19985],{"class":19299,"line":19925},36,[383,19927,19928],{"class":19307},"columns ",[383,19930,1567],{"class":19343},[383,19932,19437],{"class":19343},[383,19934,19441],{"class":19440},[383,19936,19937],{"class":19444},"temperature_c",[383,19939,19441],{"class":19440},[383,19941,1674],{"class":19343},[383,19943,19452],{"class":19440},[383,19945,19946],{"class":19444},"ad_investment",[383,19948,19441],{"class":19440},[383,19950,1674],{"class":19343},[383,19952,19452],{"class":19440},[383,19954,19955],{"class":19444},"local_event",[383,19957,19441],{"class":19440},[383,19959,1674],{"class":19343},[383,19961,19452],{"class":19440},[383,19963,19964],{"class":19444},"discount",[383,19966,19441],{"class":19440},[383,19968,1674],{"class":19343},[383,19970,19452],{"class":19440},[383,19972,19973],{"class":19444},"weather",[383,19975,19441],{"class":19440},[383,19977,1674],{"class":19343},[383,19979,19452],{"class":19440},[383,19981,19982],{"class":19444},"daily_sales",[383,19984,19441],{"class":19440},[383,19986,19469],{"class":19343},[383,19988,19990,19993,19995,19998,20000,20003,20005,20008,20010,20014,20016,20019],{"class":19299,"line":19989},37,[383,19991,19992],{"class":19307},"df ",[383,19994,1567],{"class":19343},[383,19996,19997],{"class":19307}," pd",[383,19999,1497],{"class":19343},[383,20001,20002],{"class":19307},"DataFrame",[383,20004,1933],{"class":19343},[383,20006,20007],{"class":19307},"data",[383,20009,1674],{"class":19343},[383,20011,20013],{"class":20012},"s9nN2"," columns",[383,20015,1567],{"class":19343},[383,20017,20018],{"class":19307},"columns",[383,20020,19395],{"class":19343},[383,20022,20024,20027,20029,20032],{"class":19299,"line":20023},38,[383,20025,20026],{"class":19307},"df",[383,20028,1497],{"class":19343},[383,20030,20031],{"class":19307},"head",[383,20033,20034],{"class":19343},"()\n",[299,20036,20038],{"id":20037},"step-2-knowing-the-data-initial-exploration","Step 2: Knowing the Data (Initial Exploration)",[11,20040,20041,20042,20045,20046,20049],{},"With ",[404,20043,20044],{},"df.info()"," we check for missing values (nulls) and data types, while ",[404,20047,20048],{},"df.describe()"," provides a summary of the average, maximum and minimum daily sales and expenses.",[443,20051,20053],{"className":19292,"code":20052,"language":19294,"meta":451,"style":451},"# A quick look at the health of our table\nprint(df.info())\n\n# Descriptive statistics (averages, quartiles, min\u002Fmax)\nprint(df.describe())\n",[404,20054,20055,20061,20078,20082,20087],{"__ignoreMap":451},[383,20056,20057],{"class":19299,"line":19300},[383,20058,20060],{"class":20059},"snYqZ","# A quick look at the health of our table\n",[383,20062,20063,20066,20068,20070,20072,20075],{"class":19299,"line":1823},[383,20064,20065],{"class":19500},"print",[383,20067,1933],{"class":19343},[383,20069,20026],{"class":19307},[383,20071,1497],{"class":19343},[383,20073,20074],{"class":19307},"info",[383,20076,20077],{"class":19343},"())\n",[383,20079,20080],{"class":19299,"line":1820},[383,20081,19370],{"emptyLinePlaceholder":1862},[383,20083,20084],{"class":19299,"line":1863},[383,20085,20086],{"class":20059},"# Descriptive statistics (averages, quartiles, min\u002Fmax)\n",[383,20088,20089,20091,20093,20095,20097,20100],{"class":19299,"line":19354},[383,20090,20065],{"class":19500},[383,20092,1933],{"class":19343},[383,20094,20026],{"class":19307},[383,20096,1497],{"class":19343},[383,20098,20099],{"class":19307},"describe",[383,20101,20077],{"class":19343},[11,20103,20104],{},"Resulting in the following:",[443,20106,20110],{"className":20107,"code":20108,"language":20109,"meta":451,"style":451},"language-sh shiki shiki-themes vitesse-light vitesse-dark","\u003Cclass 'pandas.core.frame.DataFrame'>\nRangeIndex: 365 entries, 0 to 364\nData columns (total 6 columns):\n #   Column         Non-Null Count  Dtype  \n---  ------         --------------  -----  \n 0   temperature_c  365 non-null    float64\n 1   ad_investment  365 non-null    float64\n 2   local_event    365 non-null    int64  \n 3   discount       365 non-null    int64  \n 4   weather        365 non-null    object \n 5   daily_sales    365 non-null    float64\ndtypes: float64(3), int64(2), object(1)\nmemory usage: 17.2+ KB\nNone\n       temperature_c  ad_investment  local_event    discount  daily_sales\ncount     365.000000     365.000000   365.000000  365.000000   365.000000\nmean       24.648767      82.490247     0.561644   11.684932   735.927151\nstd         5.687482      40.828333     0.496867    7.270059   204.863687\nmin        15.100000      10.060000     0.000000    0.000000   226.620000\n25%        19.800000      48.400000     0.000000   10.000000   576.890000\n50%        24.500000      84.780000     1.000000   15.000000   729.730000\n75%        29.600000     120.280000     1.000000   20.000000   879.280000\nmax        35.000000     149.780000     1.000000   20.000000  1337.220000\n","sh",[404,20111,20112,20117,20122,20127,20132,20137,20142,20147,20152,20157,20162,20167,20172,20177,20182,20187,20192,20197,20202,20207,20212,20217,20222],{"__ignoreMap":451},[383,20113,20114],{"class":19299,"line":19300},[383,20115,20116],{},"\u003Cclass 'pandas.core.frame.DataFrame'>\n",[383,20118,20119],{"class":19299,"line":1823},[383,20120,20121],{},"RangeIndex: 365 entries, 0 to 364\n",[383,20123,20124],{"class":19299,"line":1820},[383,20125,20126],{},"Data columns (total 6 columns):\n",[383,20128,20129],{"class":19299,"line":1863},[383,20130,20131],{}," #   Column         Non-Null Count  Dtype  \n",[383,20133,20134],{"class":19299,"line":19354},[383,20135,20136],{},"---  ------         --------------  -----  \n",[383,20138,20139],{"class":19299,"line":19367},[383,20140,20141],{}," 0   temperature_c  365 non-null    float64\n",[383,20143,20144],{"class":19299,"line":19373},[383,20145,20146],{}," 1   ad_investment  365 non-null    float64\n",[383,20148,20149],{"class":19299,"line":19398},[383,20150,20151],{}," 2   local_event    365 non-null    int64  \n",[383,20153,20154],{"class":19299,"line":19413},[383,20155,20156],{}," 3   discount       365 non-null    int64  \n",[383,20158,20159],{"class":19299,"line":19418},[383,20160,20161],{}," 4   weather        365 non-null    object \n",[383,20163,20164],{"class":19299,"line":19429},[383,20165,20166],{}," 5   daily_sales    365 non-null    float64\n",[383,20168,20169],{"class":19299,"line":19472},[383,20170,20171],{},"dtypes: float64(3), int64(2), object(1)\n",[383,20173,20174],{"class":19299,"line":19483},[383,20175,20176],{},"memory usage: 17.2+ KB\n",[383,20178,20179],{"class":19299,"line":19488},[383,20180,20181],{},"None\n",[383,20183,20184],{"class":19299,"line":19511},[383,20185,20186],{},"       temperature_c  ad_investment  local_event    discount  daily_sales\n",[383,20188,20189],{"class":19299,"line":19549},[383,20190,20191],{},"count     365.000000     365.000000   365.000000  365.000000   365.000000\n",[383,20193,20194],{"class":19299,"line":19584},[383,20195,20196],{},"mean       24.648767      82.490247     0.561644   11.684932   735.927151\n",[383,20198,20199],{"class":19299,"line":19612},[383,20200,20201],{},"std         5.687482      40.828333     0.496867    7.270059   204.863687\n",[383,20203,20204],{"class":19299,"line":19647},[383,20205,20206],{},"min        15.100000      10.060000     0.000000    0.000000   226.620000\n",[383,20208,20209],{"class":19299,"line":19668},[383,20210,20211],{},"25%        19.800000      48.400000     0.000000   10.000000   576.890000\n",[383,20213,20214],{"class":19299,"line":19673},[383,20215,20216],{},"50%        24.500000      84.780000     1.000000   15.000000   729.730000\n",[383,20218,20219],{"class":19299,"line":19684},[383,20220,20221],{},"75%        29.600000     120.280000     1.000000   20.000000   879.280000\n",[383,20223,20224],{"class":19299,"line":19694},[383,20225,20226],{},"max        35.000000     149.780000     1.000000   20.000000  1337.220000\n",[11,20228,20229],{},"Let's explore the results:",[34,20231,20232,20235,20245,20248,20251],{},[37,20233,20234],{},"The average temperature is 24.65°C, with a range between 15.1°C and 35°C.",[37,20236,20237,20238,20241,20242,1497],{},"Advertising investment varies widely, averaging ",[404,20239,20240],{},"$82.49"," and reaching a maximum of ",[404,20243,20244],{},"$149.78",[37,20246,20247],{},"56.16% of the days had a local event.",[37,20249,20250],{},"The discount applied varies, averaging 11.68% and reaching a maximum of 20%.",[37,20252,20253,20254,20257,20258,20261,20262,1497],{},"Daily sales average ",[404,20255,20256],{},"$735.93",", with wide variability, ranging from a minimum of ",[404,20259,20260],{},"$226.62"," to a maximum of ",[404,20263,20264],{},"$1337.22",[11,20266,20267],{},"Furthermore, there are no null values ​​in the dataset, which is a good sign for further analysis. The wide variability in daily sales suggests that there are significant factors affecting sales, making exploratory data analysis even more crucial for understanding these relationships.",[299,20269,20271],{"id":20270},"step-3-strategic-visualization","Step 3: Strategic Visualization",[11,20273,20274],{},"The best way to understand our data is through visualization. We will build three key charts for our analysis:",[1008,20276,20277,20283,20289],{},[37,20278,20279,20282],{},[40,20280,20281],{},"Sales Histogram:"," Tells us if our daily profits follow a normal curve (Gaussian Bell) or if they are skewed.",[37,20284,20285,20288],{},[40,20286,20287],{},"Scatter Plot (Dispersión) Advertising vs. Sales:"," Reveals whether investing more money in Ads actually increases sales or if it reaches a plateau (decreasing returns).",[37,20290,20291,20294],{},[40,20292,20293],{},"Correlation Matrix:"," Is the \"holy grail\" of EDA. It will assign a value from -1 to 1 to the relationship between all our variables.",[443,20296,20298],{"className":19292,"code":20297,"language":19294,"meta":451,"style":451},"# 1. Sales distribution (Do we sell more on \"good\" or \"bad\" days, statistically speaking?)\nplt.figure(figsize=(8,5))\nsns.histplot(df[\"daily_sales\"], bins=20, kde=True, color=\"brown\")\nplt.title(\"Distribution of Daily Coffee Sales\")\nplt.xlabel(\"Sales in $\")\nplt.ylabel(\"Frequency (Days)\")\nplt.show()\n\n# 2. The Impact of Ads\nplt.figure(figsize=(8,5))\nsns.scatterplot(x=\"ad_investment\", y=\"daily_sales\", hue=\"weather\", data=df)\nplt.title(\"Ad Investment vs. Sales\")\nplt.xlabel(\"Investment ($)\")\nplt.ylabel(\"Sales ($)\")\nplt.show()\n\n# 3. The heat map\nplt.figure(figsize=(8,6))\nsns.heatmap(df.corr(numeric_only=True), annot=True, cmap=\"YlOrBr\", fmt=\".2f\")\nplt.title(\"Variable Correlation\")\nplt.show()\n",[404,20299,20300,20305,20333,20392,20412,20432,20452,20463,20467,20472,20494,20552,20571,20590,20609,20619,20623,20628,20651,20717,20736],{"__ignoreMap":451},[383,20301,20302],{"class":19299,"line":19300},[383,20303,20304],{"class":20059},"# 1. Sales distribution (Do we sell more on \"good\" or \"bad\" days, statistically speaking?)\n",[383,20306,20307,20310,20312,20315,20317,20320,20323,20326,20328,20330],{"class":19299,"line":1823},[383,20308,20309],{"class":19307},"plt",[383,20311,1497],{"class":19343},[383,20313,20314],{"class":19307},"figure",[383,20316,1933],{"class":19343},[383,20318,20319],{"class":20012},"figsize",[383,20321,20322],{"class":19343},"=(",[383,20324,20325],{"class":19391},"8",[383,20327,1674],{"class":19343},[383,20329,9746],{"class":19391},[383,20331,20332],{"class":19343},"))\n",[383,20334,20335,20338,20340,20343,20345,20347,20349,20351,20353,20355,20358,20361,20363,20366,20368,20371,20373,20376,20378,20381,20383,20385,20388,20390],{"class":19299,"line":1820},[383,20336,20337],{"class":19307},"sns",[383,20339,1497],{"class":19343},[383,20341,20342],{"class":19307},"histplot",[383,20344,1933],{"class":19343},[383,20346,20026],{"class":19307},[383,20348,16861],{"class":19343},[383,20350,19441],{"class":19440},[383,20352,19982],{"class":19444},[383,20354,19441],{"class":19440},[383,20356,20357],{"class":19343},"],",[383,20359,20360],{"class":20012}," bins",[383,20362,1567],{"class":19343},[383,20364,20365],{"class":19391},"20",[383,20367,1674],{"class":19343},[383,20369,20370],{"class":20012}," kde",[383,20372,1567],{"class":19343},[383,20374,20375],{"class":19303},"True",[383,20377,1674],{"class":19343},[383,20379,20380],{"class":20012}," color",[383,20382,1567],{"class":19343},[383,20384,19441],{"class":19440},[383,20386,20387],{"class":19444},"brown",[383,20389,19441],{"class":19440},[383,20391,19395],{"class":19343},[383,20393,20394,20396,20398,20401,20403,20405,20408,20410],{"class":19299,"line":1863},[383,20395,20309],{"class":19307},[383,20397,1497],{"class":19343},[383,20399,20400],{"class":19307},"title",[383,20402,1933],{"class":19343},[383,20404,19441],{"class":19440},[383,20406,20407],{"class":19444},"Distribution of Daily Coffee Sales",[383,20409,19441],{"class":19440},[383,20411,19395],{"class":19343},[383,20413,20414,20416,20418,20421,20423,20425,20428,20430],{"class":19299,"line":19354},[383,20415,20309],{"class":19307},[383,20417,1497],{"class":19343},[383,20419,20420],{"class":19307},"xlabel",[383,20422,1933],{"class":19343},[383,20424,19441],{"class":19440},[383,20426,20427],{"class":19444},"Sales in $",[383,20429,19441],{"class":19440},[383,20431,19395],{"class":19343},[383,20433,20434,20436,20438,20441,20443,20445,20448,20450],{"class":19299,"line":19367},[383,20435,20309],{"class":19307},[383,20437,1497],{"class":19343},[383,20439,20440],{"class":19307},"ylabel",[383,20442,1933],{"class":19343},[383,20444,19441],{"class":19440},[383,20446,20447],{"class":19444},"Frequency (Days)",[383,20449,19441],{"class":19440},[383,20451,19395],{"class":19343},[383,20453,20454,20456,20458,20461],{"class":19299,"line":19373},[383,20455,20309],{"class":19307},[383,20457,1497],{"class":19343},[383,20459,20460],{"class":19307},"show",[383,20462,20034],{"class":19343},[383,20464,20465],{"class":19299,"line":19398},[383,20466,19370],{"emptyLinePlaceholder":1862},[383,20468,20469],{"class":19299,"line":19413},[383,20470,20471],{"class":20059},"# 2. The Impact of Ads\n",[383,20473,20474,20476,20478,20480,20482,20484,20486,20488,20490,20492],{"class":19299,"line":19418},[383,20475,20309],{"class":19307},[383,20477,1497],{"class":19343},[383,20479,20314],{"class":19307},[383,20481,1933],{"class":19343},[383,20483,20319],{"class":20012},[383,20485,20322],{"class":19343},[383,20487,20325],{"class":19391},[383,20489,1674],{"class":19343},[383,20491,9746],{"class":19391},[383,20493,20332],{"class":19343},[383,20495,20496,20498,20500,20503,20505,20507,20509,20511,20513,20515,20517,20520,20522,20524,20526,20528,20530,20533,20535,20537,20539,20541,20543,20546,20548,20550],{"class":19299,"line":19429},[383,20497,20337],{"class":19307},[383,20499,1497],{"class":19343},[383,20501,20502],{"class":19307},"scatterplot",[383,20504,1933],{"class":19343},[383,20506,1940],{"class":20012},[383,20508,1567],{"class":19343},[383,20510,19441],{"class":19440},[383,20512,19946],{"class":19444},[383,20514,19441],{"class":19440},[383,20516,1674],{"class":19343},[383,20518,20519],{"class":20012}," y",[383,20521,1567],{"class":19343},[383,20523,19441],{"class":19440},[383,20525,19982],{"class":19444},[383,20527,19441],{"class":19440},[383,20529,1674],{"class":19343},[383,20531,20532],{"class":20012}," hue",[383,20534,1567],{"class":19343},[383,20536,19441],{"class":19440},[383,20538,19973],{"class":19444},[383,20540,19441],{"class":19440},[383,20542,1674],{"class":19343},[383,20544,20545],{"class":20012}," data",[383,20547,1567],{"class":19343},[383,20549,20026],{"class":19307},[383,20551,19395],{"class":19343},[383,20553,20554,20556,20558,20560,20562,20564,20567,20569],{"class":19299,"line":19472},[383,20555,20309],{"class":19307},[383,20557,1497],{"class":19343},[383,20559,20400],{"class":19307},[383,20561,1933],{"class":19343},[383,20563,19441],{"class":19440},[383,20565,20566],{"class":19444},"Ad Investment vs. Sales",[383,20568,19441],{"class":19440},[383,20570,19395],{"class":19343},[383,20572,20573,20575,20577,20579,20581,20583,20586,20588],{"class":19299,"line":19483},[383,20574,20309],{"class":19307},[383,20576,1497],{"class":19343},[383,20578,20420],{"class":19307},[383,20580,1933],{"class":19343},[383,20582,19441],{"class":19440},[383,20584,20585],{"class":19444},"Investment ($)",[383,20587,19441],{"class":19440},[383,20589,19395],{"class":19343},[383,20591,20592,20594,20596,20598,20600,20602,20605,20607],{"class":19299,"line":19488},[383,20593,20309],{"class":19307},[383,20595,1497],{"class":19343},[383,20597,20440],{"class":19307},[383,20599,1933],{"class":19343},[383,20601,19441],{"class":19440},[383,20603,20604],{"class":19444},"Sales ($)",[383,20606,19441],{"class":19440},[383,20608,19395],{"class":19343},[383,20610,20611,20613,20615,20617],{"class":19299,"line":19511},[383,20612,20309],{"class":19307},[383,20614,1497],{"class":19343},[383,20616,20460],{"class":19307},[383,20618,20034],{"class":19343},[383,20620,20621],{"class":19299,"line":19549},[383,20622,19370],{"emptyLinePlaceholder":1862},[383,20624,20625],{"class":19299,"line":19584},[383,20626,20627],{"class":20059},"# 3. The heat map\n",[383,20629,20630,20632,20634,20636,20638,20640,20642,20644,20646,20649],{"class":19299,"line":19612},[383,20631,20309],{"class":19307},[383,20633,1497],{"class":19343},[383,20635,20314],{"class":19307},[383,20637,1933],{"class":19343},[383,20639,20319],{"class":20012},[383,20641,20322],{"class":19343},[383,20643,20325],{"class":19391},[383,20645,1674],{"class":19343},[383,20647,20648],{"class":19391},"6",[383,20650,20332],{"class":19343},[383,20652,20653,20655,20657,20660,20662,20664,20666,20669,20671,20674,20676,20678,20680,20683,20685,20687,20689,20692,20694,20696,20699,20701,20703,20706,20708,20710,20713,20715],{"class":19299,"line":19647},[383,20654,20337],{"class":19307},[383,20656,1497],{"class":19343},[383,20658,20659],{"class":19307},"heatmap",[383,20661,1933],{"class":19343},[383,20663,20026],{"class":19307},[383,20665,1497],{"class":19343},[383,20667,20668],{"class":19307},"corr",[383,20670,1933],{"class":19343},[383,20672,20673],{"class":20012},"numeric_only",[383,20675,1567],{"class":19343},[383,20677,20375],{"class":19303},[383,20679,19541],{"class":19343},[383,20681,20682],{"class":20012}," annot",[383,20684,1567],{"class":19343},[383,20686,20375],{"class":19303},[383,20688,1674],{"class":19343},[383,20690,20691],{"class":20012}," cmap",[383,20693,1567],{"class":19343},[383,20695,19441],{"class":19440},[383,20697,20698],{"class":19444},"YlOrBr",[383,20700,19441],{"class":19440},[383,20702,1674],{"class":19343},[383,20704,20705],{"class":20012}," fmt",[383,20707,1567],{"class":19343},[383,20709,19441],{"class":19440},[383,20711,20712],{"class":19444},".2f",[383,20714,19441],{"class":19440},[383,20716,19395],{"class":19343},[383,20718,20719,20721,20723,20725,20727,20729,20732,20734],{"class":19299,"line":19668},[383,20720,20309],{"class":19307},[383,20722,1497],{"class":19343},[383,20724,20400],{"class":19307},[383,20726,1933],{"class":19343},[383,20728,19441],{"class":19440},[383,20730,20731],{"class":19444},"Variable Correlation",[383,20733,19441],{"class":19440},[383,20735,19395],{"class":19343},[383,20737,20738,20740,20742,20744],{"class":19299,"line":19673},[383,20739,20309],{"class":19307},[383,20741,1497],{"class":19343},[383,20743,20460],{"class":19307},[383,20745,20034],{"class":19343},[11,20747,20748,20752],{},[80,20749],{"alt":20750,"src":20751},"Daily sales distribution","\u002Fblog\u002Fexperimenting-with-exploratory-data-analysis\u002Fshared\u002Fsales_distribution.webp",[85,20753,20754],{},"Sales Histogram",[11,20756,20757,20758,20761],{},"Let's start with the histogram, which allows us to visualize how daily sales are distributed over time. In this case, we observe that sales follow an approximately normal distribution, with a mean close to ",[404,20759,20760],{},"$800",". This means that most days sales are concentrated around this average value, and that days with very low or very high sales are less frequent and are distributed relatively symmetrically on both sides.",[34,20763,20764],{},[37,20765,20766],{},"Why is it important to identify a normal distribution?",[11,20768,20769],{},"Because many statistical and machine learning models, such as linear regression, analysis of variance, or certain probabilistic models, perform better when the data (or at least the model errors) follow a normal distribution.",[11,20771,20772],{},"When this condition is met:",[34,20774,20775,20778,20781],{},[37,20776,20777],{},"Estimates tend to be more stable.",[37,20779,20780],{},"Confidence intervals and statistical tests are more reliable.",[37,20782,20783],{},"The model is not excessively affected by extreme values.",[11,20785,20786,20787,20790],{},"If the data ",[40,20788,20789],{},"does not"," follow a normal distribution, it may be necessary to apply mathematical transformations (such as logarithms, square roots, or Box-Cox transformations) to stabilize the variance and reduce skewness.",[34,20792,20793],{},[37,20794,20795],{},"What do \"right skew\" and \"left skew\" mean?",[34,20797,20798,20804],{},[37,20799,20800,20803],{},[40,20801,20802],{},"Right skew (positive skewness):"," There is a long tail toward high values. This indicates that there are few days with extremely high sales.",[37,20805,20806,20809],{},[40,20807,20808],{},"Left skew (negative skewness):"," There is a long tail toward low values. This indicates that there are few days with unusually low sales.",[11,20811,20812],{},"Skewness is important because models sensitive to extreme values ​​can become distorted.",[11,20814,20815,20816,72,20819,20822,20823,1497],{},"Let's assume that most days sales are between ",[404,20817,20818],{},"$700",[404,20820,20821],{},"$900",", but on three special days (for example, promotions or holidays) sales reach ",[404,20824,20825],{},"$2,500",[11,20827,20828],{},"If we train a linear regression directly with this data:",[34,20830,20831,20834,20837],{},[37,20832,20833],{},"The model will attempt to fit a line that also accounts for these spikes.",[37,20835,20836],{},"This can shift the slope or intercept.",[37,20838,20839],{},"As a result, predictions for \"normal\" days (which are the majority) might be slightly inflated.",[11,20841,20842],{},"In contrast, if we apply a logarithmic transformation before training the model:",[34,20844,20845,20848,20851],{},[37,20846,20847],{},"The impact of extremely high values ​​is reduced.",[37,20849,20850],{},"The distribution becomes more symmetrical.",[37,20852,20853],{},"The model learns a pattern that is more representative of the overall behavior.",[11,20855,20856,20860],{},[80,20857],{"alt":20858,"src":20859},"Advertising vs Sales","\u002Fblog\u002Fexperimenting-with-exploratory-data-analysis\u002Fshared\u002Fads_vs_sales.webp",[85,20861,20862],{},"Dispersion between Advertising Investment and Sales",[11,20864,20865],{},"The points are colored according to the weather: Blue-Sunny, Orange-Cloudy, Green-Rainy",[34,20867,20868],{},[37,20869,20870],{},[40,20871,20872],{},"Main Relationship: Investment vs. Sales",[11,20874,20875,20876,1173],{},"The first thing to note is a ",[40,20877,20878],{},"positive trend",[11,20880,20881],{},"As advertising investment increases, sales tend to increase.",[11,20883,20884,20885,20888],{},"This indicates a ",[40,20886,20887],{},"positive correlation"," between the two variables. It doesn't appear to be a completely random relationship; the points show a general upward slope.",[11,20890,20891,20892,20894],{},"In machine learning terms, this suggests that advertising investment is ",[40,20893,18],{}," relevant predictor variable for estimating sales (though not the only one).",[34,20896,20897],{},[37,20898,20899],{},[40,20900,20901],{},"Sales Variability",[11,20903,20904],{},"Although the trend is positive, the points are quite dispersed vertically.",[11,20906,20907],{},"For example:",[11,20909,20910,20911,20914,20915,72,20918,20921],{},"With an investment of ",[404,20912,20913],{},"$100",", sales can vary between approximately ",[404,20916,20917],{},"$400",[404,20919,20920],{},"$1,100"," depending on other factors.",[11,20923,20924],{},"This tells us something very important:",[293,20926,20927],{},[11,20928,20929],{},"Investment does not explain 100% of sales performance.",[11,20931,20932],{},"There are other influencing variables (in this case, we know that weather is one of them).",[34,20934,20935],{},[37,20936,20937],{},[40,20938,20939],{},"Impact of Weather",[11,20941,20942],{},"This is where the graph becomes more interesting.",[11,20944,20945],{},"Looking at the colors:",[34,20947,20948,20951,20954],{},[37,20949,20950],{},"Green dots (rainy) tend to be located at higher sales values.",[37,20952,20953],{},"Blue dots (sunny) tend to be concentrated at lower values ​​for the same level of investment.",[37,20955,20956],{},"Orange dots (cloudy) are somewhere in between.",[11,20958,20959,20960,1497],{},"This suggests that weather acts as a ",[40,20961,20962],{},"moderating variable",[11,20964,20907],{},[11,20966,20910,20967,1173],{},[404,20968,20969],{},"$120",[34,20971,20972,20978],{},[37,20973,20974,20975],{},"Sunny day → sales around ",[404,20976,20977],{},"$500–900",[37,20979,20980,20981],{},"Rainy day → sales around ",[404,20982,20983],{},"$700–1,200",[11,20985,20986],{},"In a simple regression model that only uses investment, these differences would generate large errors.",[34,20988,20989],{},[37,20990,20991],{},[40,20992,20993],{},"Implication for Modeling",[11,20995,20996],{},"If we train a model using only investment:",[383,20998,21000],{"className":20999},[2494],[383,21001,21003,21040],{"className":21002},[1545],[383,21004,21006],{"className":21005},[1549],[1551,21007,21008],{"xmlns":1553,"display":2503},[1555,21009,21010,21037],{},[1558,21011,21012,21016,21018,21024,21026,21032,21034],{},[21013,21014,21015],"mtext",{},"Sales",[1565,21017,1567],{},[1935,21019,21020,21022],{},[1938,21021,2910],{},[1561,21023,2913],{},[1565,21025,2916],{},[1935,21027,21028,21030],{},[1938,21029,2910],{},[1561,21031,1943],{},[1565,21033,16866],{},[21013,21035,21036],{},"Investment",[1569,21038,21039],{"encoding":1571},"\\text{Sales} = \\beta_0 + \\beta_1 \\cdot \\text{Investment}",[383,21041,21043,21064,21119,21174],{"className":21042,"ariaHidden":1577},[1576],[383,21044,21046,21049,21055,21058,21061],{"className":21045},[1581],[383,21047],{"className":21048,"style":5334},[1585],[383,21050,21052],{"className":21051},[1590,448],[383,21053,21015],{"className":21054},[1590],[383,21056],{"className":21057,"style":1595},[1594],[383,21059,1567],{"className":21060},[1599],[383,21062],{"className":21063,"style":1595},[1594],[383,21065,21067,21070,21110,21113,21116],{"className":21066},[1581],[383,21068],{"className":21069,"style":2534},[1585],[383,21071,21073,21076],{"className":21072},[1590],[383,21074,2910],{"className":21075,"style":3006},[1590,2033],[383,21077,21079],{"className":21078},[2037],[383,21080,21082,21102],{"className":21081},[2041,2042],[383,21083,21085,21099],{"className":21084},[2046],[383,21086,21088],{"className":21087,"style":2051},[2050],[383,21089,21090,21093],{"style":3021},[383,21091],{"className":21092,"style":2059},[2058],[383,21094,21096],{"className":21095},[2063,2064,2065,2066],[383,21097,2913],{"className":21098},[1590,2066],[383,21100,2074],{"className":21101},[2073],[383,21103,21105],{"className":21104},[2046],[383,21106,21108],{"className":21107,"style":2081},[2050],[383,21109],{},[383,21111],{"className":21112,"style":2577},[1594],[383,21114,2916],{"className":21115},[3048],[383,21117],{"className":21118,"style":2577},[1594],[383,21120,21122,21125,21165,21168,21171],{"className":21121},[1581],[383,21123],{"className":21124,"style":2534},[1585],[383,21126,21128,21131],{"className":21127},[1590],[383,21129,2910],{"className":21130,"style":3006},[1590,2033],[383,21132,21134],{"className":21133},[2037],[383,21135,21137,21157],{"className":21136},[2041,2042],[383,21138,21140,21154],{"className":21139},[2046],[383,21141,21143],{"className":21142,"style":2051},[2050],[383,21144,21145,21148],{"style":3021},[383,21146],{"className":21147,"style":2059},[2058],[383,21149,21151],{"className":21150},[2063,2064,2065,2066],[383,21152,1943],{"className":21153},[1590,2066],[383,21155,2074],{"className":21156},[2073],[383,21158,21160],{"className":21159},[2046],[383,21161,21163],{"className":21162,"style":2081},[2050],[383,21164],{},[383,21166],{"className":21167,"style":2577},[1594],[383,21169,16866],{"className":21170},[3048],[383,21172],{"className":21173,"style":2577},[1594],[383,21175,21177,21180],{"className":21176},[1581],[383,21178],{"className":21179,"style":2554},[1585],[383,21181,21183],{"className":21182},[1590,448],[383,21184,21036],{"className":21185},[1590],[11,21187,21188],{},"The model will capture the general trend, but will have systematic errors depending on the weather.",[11,21190,21191],{},"In contrast, if we include the weather as a categorical variable (for example, using one-hot encoding):",[383,21193,21195],{"className":21194},[2494],[383,21196,21198,21245],{"className":21197},[1545],[383,21199,21201],{"className":21200},[1549],[1551,21202,21203],{"xmlns":1553,"display":2503},[1555,21204,21205,21242],{},[1558,21206,21207,21209,21211,21217,21219,21225,21227,21229,21231,21237,21239],{},[21013,21208,21015],{},[1565,21210,1567],{},[1935,21212,21213,21215],{},[1938,21214,2910],{},[1561,21216,2913],{},[1565,21218,2916],{},[1935,21220,21221,21223],{},[1938,21222,2910],{},[1561,21224,1943],{},[1565,21226,16866],{},[21013,21228,21036],{},[1565,21230,2916],{},[1935,21232,21233,21235],{},[1938,21234,2910],{},[1561,21236,1563],{},[1565,21238,16866],{},[21013,21240,21241],{},"Weather",[1569,21243,21244],{"encoding":1571},"\\text{Sales} = \\beta_0 + \\beta_1 \\cdot \\text{Investment} + \\beta_2 \\cdot \\text{Weather}",[383,21246,21248,21269,21324,21379,21401,21456],{"className":21247,"ariaHidden":1577},[1576],[383,21249,21251,21254,21260,21263,21266],{"className":21250},[1581],[383,21252],{"className":21253,"style":5334},[1585],[383,21255,21257],{"className":21256},[1590,448],[383,21258,21015],{"className":21259},[1590],[383,21261],{"className":21262,"style":1595},[1594],[383,21264,1567],{"className":21265},[1599],[383,21267],{"className":21268,"style":1595},[1594],[383,21270,21272,21275,21315,21318,21321],{"className":21271},[1581],[383,21273],{"className":21274,"style":2534},[1585],[383,21276,21278,21281],{"className":21277},[1590],[383,21279,2910],{"className":21280,"style":3006},[1590,2033],[383,21282,21284],{"className":21283},[2037],[383,21285,21287,21307],{"className":21286},[2041,2042],[383,21288,21290,21304],{"className":21289},[2046],[383,21291,21293],{"className":21292,"style":2051},[2050],[383,21294,21295,21298],{"style":3021},[383,21296],{"className":21297,"style":2059},[2058],[383,21299,21301],{"className":21300},[2063,2064,2065,2066],[383,21302,2913],{"className":21303},[1590,2066],[383,21305,2074],{"className":21306},[2073],[383,21308,21310],{"className":21309},[2046],[383,21311,21313],{"className":21312,"style":2081},[2050],[383,21314],{},[383,21316],{"className":21317,"style":2577},[1594],[383,21319,2916],{"className":21320},[3048],[383,21322],{"className":21323,"style":2577},[1594],[383,21325,21327,21330,21370,21373,21376],{"className":21326},[1581],[383,21328],{"className":21329,"style":2534},[1585],[383,21331,21333,21336],{"className":21332},[1590],[383,21334,2910],{"className":21335,"style":3006},[1590,2033],[383,21337,21339],{"className":21338},[2037],[383,21340,21342,21362],{"className":21341},[2041,2042],[383,21343,21345,21359],{"className":21344},[2046],[383,21346,21348],{"className":21347,"style":2051},[2050],[383,21349,21350,21353],{"style":3021},[383,21351],{"className":21352,"style":2059},[2058],[383,21354,21356],{"className":21355},[2063,2064,2065,2066],[383,21357,1943],{"className":21358},[1590,2066],[383,21360,2074],{"className":21361},[2073],[383,21363,21365],{"className":21364},[2046],[383,21366,21368],{"className":21367,"style":2081},[2050],[383,21369],{},[383,21371],{"className":21372,"style":2577},[1594],[383,21374,16866],{"className":21375},[3048],[383,21377],{"className":21378,"style":2577},[1594],[383,21380,21382,21386,21392,21395,21398],{"className":21381},[1581],[383,21383],{"className":21384,"style":21385},[1585],"height:0.7667em;vertical-align:-0.0833em;",[383,21387,21389],{"className":21388},[1590,448],[383,21390,21036],{"className":21391},[1590],[383,21393],{"className":21394,"style":2577},[1594],[383,21396,2916],{"className":21397},[3048],[383,21399],{"className":21400,"style":2577},[1594],[383,21402,21404,21407,21447,21450,21453],{"className":21403},[1581],[383,21405],{"className":21406,"style":2534},[1585],[383,21408,21410,21413],{"className":21409},[1590],[383,21411,2910],{"className":21412,"style":3006},[1590,2033],[383,21414,21416],{"className":21415},[2037],[383,21417,21419,21439],{"className":21418},[2041,2042],[383,21420,21422,21436],{"className":21421},[2046],[383,21423,21425],{"className":21424,"style":2051},[2050],[383,21426,21427,21430],{"style":3021},[383,21428],{"className":21429,"style":2059},[2058],[383,21431,21433],{"className":21432},[2063,2064,2065,2066],[383,21434,1563],{"className":21435},[1590,2066],[383,21437,2074],{"className":21438},[2073],[383,21440,21442],{"className":21441},[2046],[383,21443,21445],{"className":21444,"style":2081},[2050],[383,21446],{},[383,21448],{"className":21449,"style":2577},[1594],[383,21451,16866],{"className":21452},[3048],[383,21454],{"className":21455,"style":2577},[1594],[383,21457,21459,21462],{"className":21458},[1581],[383,21460],{"className":21461,"style":5334},[1585],[383,21463,21465],{"className":21464},[1590,448],[383,21466,21241],{"className":21467},[1590],[11,21469,21470],{},"The model will be able to:",[34,21472,21473,21476,21479],{},[37,21474,21475],{},"Adjust different intercepts by weather (for example, an extra term for rainy days).",[37,21477,21478],{},"Improve precision (since it allows us to capture that additional variability).",[37,21480,21481],{},"Reduce error variance (because the variance, that is, the spread of the points around the regression line, is reduced when explaining more factors).",[11,21483,21484,21488],{},[80,21485],{"alt":21486,"src":21487},"Cafeteria Correlation Matrix","\u002Fblog\u002Fexperimenting-with-exploratory-data-analysis\u002Fshared\u002Fcafeteria_correlation_matrix.webp",[85,21489,21490],{},"Correlation Heatmap",[11,21492,21493],{},"Let's break down the correlation matrix, interpreting each value, but first, let's remember what each number means:",[34,21495,21496,21502,21508],{},[37,21497,21498,21501],{},[40,21499,21500],{},"1.00",": perfect positive correlation",[37,21503,21504,21507],{},[40,21505,21506],{},"0.00",": no linear relationship",[37,21509,21510,21513],{},[40,21511,21512],{},"-1.00",": perfect negative correlation",[11,21515,21516,21517,21520],{},"The matrix is ​​",[40,21518,21519],{},"symmetric",", that is:",[443,21522,21525],{"className":21523,"code":21524,"language":448},[446],"Corr(A, B) = Corr(B, A)\n",[404,21526,21524],{"__ignoreMap":451},[11,21528,21529],{},"That's why you'll see the same values ​​reflected above and below the diagonal.",[11,21531,21532,21533,21535],{},"The main diagonal is always ",[40,21534,21500],{},", because each variable is perfectly correlated with itself.",[11,21537,21538],{},"The variables included are:",[34,21540,21541,21545,21549,21553,21557],{},[37,21542,21543],{},[404,21544,19937],{},[37,21546,21547],{},[404,21548,19946],{},[37,21550,21551],{},[404,21552,19955],{},[37,21554,21555],{},[404,21556,19964],{},[37,21558,21559],{},[404,21560,19982],{},[1008,21562,21563],{},[37,21564,21565,21567],{},[404,21566,19937],{},": Temperature in degrees Celsius.",[34,21569,21570,21576,21583,21590,21597],{},[37,21571,21572,21573,21575],{},"temperature_c - temperature_c = ",[40,21574,21500],{},"\nPerfect correlation with itself.",[37,21577,21578,21579,21582],{},"temperature_c - ad_investment = ",[40,21580,21581],{},"-0.03","\nPractically no relationship.\nTemperature does not influence how much is invested in advertising.",[37,21584,21585,21586,21589],{},"temperature_c - local_event = ",[40,21587,21588],{},"0.05","\nVery weak positive correlation.\nLocal events do not really depend on the weather in this dataset.",[37,21591,21592,21593,21596],{},"temperature_c - discount = ",[40,21594,21595],{},"0.04","\nNo relevant relationship.\nDiscounts do not appear to be affected by temperature.",[37,21598,21599,21600,21603,21604,21607,21608,21616,21618],{},"temperature_c - daily_sales = ",[40,21601,21602],{},"-0.24","\nWeak to moderate negative correlation.\nWhen the temperature rises, sales tend to decrease slightly.",[21605,21606],"br",{},"This may indicate:",[34,21609,21610,21613],{},[37,21611,21612],{},"The business sells products that are consumed more in cooler weather.",[37,21614,21615],{},"There is less foot traffic on very hot days.",[21605,21617],{},"It is not a strong relationship, but it is consistent.",[1008,21620,21621],{"start":1823},[37,21622,21623,21625],{},[404,21624,19946],{},": Investment in advertising.",[34,21627,21628,21633,21640,21646],{},[37,21629,21630,21631],{},"ad_investment - ad_investment = ",[40,21632,21500],{},[37,21634,21635,21636,21639],{},"ad_investment - local_event = ",[40,21637,21638],{},"-0.05","\nPractically independent.\nAdvertising investment does not depend directly on whether there is an event.",[37,21641,21642,21643,21645],{},"ad_investment - discount = ",[40,21644,21581],{},"\nNo relationship.\nInvestment and discounts appear to be separate decisions.",[37,21647,21648,21649,21652,21653,21655,21656,21667,21669],{},"ad_investment - daily_sales = ",[40,21650,21651],{},"0.47","\nModerate positive correlation.",[21605,21654],{},"This means:",[34,21657,21658,21661,21664],{},[37,21659,21660],{},"Higher investment leads to higher sales.",[37,21662,21663],{},"The relationship is significant, but not perfect.",[37,21665,21666],{},"Other factors are also influencing it.",[21605,21668],{},"Statistically, it is an important predictor.",[1008,21671,21672],{"start":1820},[37,21673,21674,21676],{},[404,21675,19955],{},": Local event.",[34,21678,21679,21684,21691],{},[37,21680,21681,21682],{},"local_event - local_event = ",[40,21683,21500],{},[37,21685,21686,21687,21690],{},"local_event - discount = ",[40,21688,21689],{},"-0.06","\nAlmost no correlation.\nIt doesn't seem that events necessarily imply discounts.",[37,21692,21693,21694,21697,21698,21700,21701,21712,21714],{},"local_event - daily_sales = ",[40,21695,21696],{},"0.57","\nThis is the highest correlation with sales.",[21605,21699],{},"Interpretation:",[34,21702,21703,21706,21709],{},[37,21704,21705],{},"When there is a local event, sales increase significantly.",[37,21707,21708],{},"It is the most influential factor in the dataset.",[37,21710,21711],{},"It represents a key variable for the model.",[21605,21713],{},"In practical terms:\nEvents generate additional traffic or demand.",[1008,21716,21717],{"start":1863},[37,21718,21719,21721],{},[404,21720,19964],{},": Discount.",[34,21723,21724,21727],{},[37,21725,21726],{},"discount - discount = 1.00",[37,21728,21729,21730,21655,21732,21740,21742,21743],{},"discount - daily_sales = 0.13\nWeak positive correlation.",[21605,21731],{},[34,21733,21734,21737],{},[37,21735,21736],{},"Discounts have a small impact.",[37,21738,21739],{},"They don't appear to be the main driver of sales.",[21605,21741],{},"Possible explanations:",[34,21744,21745,21748,21751],{},[37,21746,21747],{},"Low discounts",[37,21749,21750],{},"Poor strategy",[37,21752,21753],{},"Or an effect conditioned by other variables",[1008,21755,21756],{"start":19354},[37,21757,21758,21760],{},[404,21759,19982],{},": Daily sales.",[11,21762,21763],{},"We have already interpreted all their correlations with the other variables:",[836,21765,21766,21775],{},[839,21767,21768],{},[842,21769,21770,21773],{},[845,21771,21772],{},"Variable",[845,21774,682],{},[854,21776,21777,21783,21789,21795],{},[842,21778,21779,21781],{},[859,21780,19937],{},[859,21782,21602],{},[842,21784,21785,21787],{},[859,21786,19946],{},[859,21788,21651],{},[842,21790,21791,21793],{},[859,21792,19955],{},[859,21794,21696],{},[842,21796,21797,21799],{},[859,21798,19964],{},[859,21800,21801],{},"0.13",[11,21803,21804],{},"Ordered by linear impact:",[1008,21806,21807,21810,21813,21816],{},[37,21808,21809],{},"local_event (0.57)",[37,21811,21812],{},"ad_investment (0.47)",[37,21814,21815],{},"temperature_c (-0.24)",[37,21817,21818],{},"discount (0.13)",[11,21820,21821],{},[40,21822,21823],{},"What does this tell us in terms of modeling?",[11,21825,21826],{},"First, the most predictive variables for estimating sales are:",[34,21828,21829,21831],{},[37,21830,19955],{},[37,21832,19946],{},[11,21834,21835],{},"Both should be included in the model.",[11,21837,21838],{},"Then we have multicollinearity.",[11,21840,21841],{},"We observe that:",[34,21843,21844,21847],{},[37,21845,21846],{},"No independent variable has a high correlation with another.",[37,21848,21849],{},"All values ​​between predictors are close to 0.",[11,21851,21852],{},"This is excellent because it means there is no strong redundancy and that each variable provides distinct information.",[11,21854,21855],{},"If we had values ​​close to 1 or -1 between predictors (for example, ad_investment and local_event), we would have to consider removing or combining variables to avoid multicollinearity problems.",[11,21857,21858],{},"So, with all this, we can conclude:",[34,21860,21861,21864,21867,21870,21873,21876],{},[37,21862,21863],{},"Local events are the main sales driver.",[37,21865,21866],{},"Advertising investment has a clear and consistent impact.",[37,21868,21869],{},"Temperature has a slightly negative effect.",[37,21871,21872],{},"Discounts have a low impact.",[37,21874,21875],{},"There is no problematic multicollinearity.",[37,21877,21878],{},"The dataset is suitable for a multiple regression model.",[293,21880,21881,21884],{},[11,21882,21883],{},"With this information, a coffee shop manager could make strategic decisions such as:",[34,21885,21886,21889,21892,21895],{},[37,21887,21888],{},"Prioritize campaigns during local events.",[37,21890,21891],{},"Maintain consistent advertising investment.",[37,21893,21894],{},"Re-evaluate discount strategy.",[37,21896,21897],{},"Consider specific strategies for hot days.",[299,21899,21901],{"id":21900},"step-4-from-data-to-prediction-modeling","Step 4: From Data to Prediction (Modeling)",[11,21903,21904,21905,21908],{},"With the completed EDA, we transform the weather data into a binary format and feed it into a ",[40,21906,21907],{},"Simple Linear Regression"," model.",[443,21910,21912],{"className":19292,"code":21911,"language":19294,"meta":451,"style":451},"from sklearn.model_selection import train_test_split\nfrom sklearn.linear_model import LinearRegression\nfrom sklearn.metrics import mean_absolute_error, mean_squared_error, r2_score\n\n# One-Hot Encoding: Converts \"Sunny\" or \"Rainy\" into columns of 0s and 1s\ndf_encoded = pd.get_dummies(df, columns=[\"weather\"])\nX = df_encoded.drop(\"daily_sales\", axis=1)\ny = df_encoded[\"daily_sales\"]\n\n# Train-test split: 80% for training, 20% for testing\nX_train, X_test, y_train, y_test = train_test_split(X, y, test_size=0.2, random_state=42)\n\ncoffee_shop_model = LinearRegression()\ncoffee_shop_model.fit(X_train, y_train)\n\n# Make predictions on the test set\npredictions = coffee_shop_model.predict(X_test)\n",[404,21913,21914,21932,21948,21974,21978,21983,22016,22050,22069,22073,22078,22132,22136,22148,22168,22172,22177],{"__ignoreMap":451},[383,21915,21916,21919,21922,21924,21927,21929],{"class":19299,"line":19300},[383,21917,21918],{"class":19303},"from",[383,21920,21921],{"class":19307}," sklearn",[383,21923,1497],{"class":19343},[383,21925,21926],{"class":19307},"model_selection ",[383,21928,19304],{"class":19303},[383,21930,21931],{"class":19307}," train_test_split\n",[383,21933,21934,21936,21938,21940,21943,21945],{"class":19299,"line":1823},[383,21935,21918],{"class":19303},[383,21937,21921],{"class":19307},[383,21939,1497],{"class":19343},[383,21941,21942],{"class":19307},"linear_model ",[383,21944,19304],{"class":19303},[383,21946,21947],{"class":19307}," LinearRegression\n",[383,21949,21950,21952,21954,21956,21959,21961,21964,21966,21969,21971],{"class":19299,"line":1820},[383,21951,21918],{"class":19303},[383,21953,21921],{"class":19307},[383,21955,1497],{"class":19343},[383,21957,21958],{"class":19307},"metrics ",[383,21960,19304],{"class":19303},[383,21962,21963],{"class":19307}," mean_absolute_error",[383,21965,1674],{"class":19343},[383,21967,21968],{"class":19307}," mean_squared_error",[383,21970,1674],{"class":19343},[383,21972,21973],{"class":19307}," r2_score\n",[383,21975,21976],{"class":19299,"line":1863},[383,21977,19370],{"emptyLinePlaceholder":1862},[383,21979,21980],{"class":19299,"line":19354},[383,21981,21982],{"class":20059},"# One-Hot Encoding: Converts \"Sunny\" or \"Rainy\" into columns of 0s and 1s\n",[383,21984,21985,21988,21990,21992,21994,21997,21999,22001,22003,22005,22008,22010,22012,22014],{"class":19299,"line":19367},[383,21986,21987],{"class":19307},"df_encoded ",[383,21989,1567],{"class":19343},[383,21991,19997],{"class":19307},[383,21993,1497],{"class":19343},[383,21995,21996],{"class":19307},"get_dummies",[383,21998,1933],{"class":19343},[383,22000,20026],{"class":19307},[383,22002,1674],{"class":19343},[383,22004,20013],{"class":20012},[383,22006,22007],{"class":19343},"=[",[383,22009,19441],{"class":19440},[383,22011,19973],{"class":19444},[383,22013,19441],{"class":19440},[383,22015,19609],{"class":19343},[383,22017,22018,22021,22023,22026,22028,22031,22033,22035,22037,22039,22041,22044,22046,22048],{"class":19299,"line":19373},[383,22019,22020],{"class":19307},"X ",[383,22022,1567],{"class":19343},[383,22024,22025],{"class":19307}," df_encoded",[383,22027,1497],{"class":19343},[383,22029,22030],{"class":19307},"drop",[383,22032,1933],{"class":19343},[383,22034,19441],{"class":19440},[383,22036,19982],{"class":19444},[383,22038,19441],{"class":19440},[383,22040,1674],{"class":19343},[383,22042,22043],{"class":20012}," axis",[383,22045,1567],{"class":19343},[383,22047,1943],{"class":19391},[383,22049,19395],{"class":19343},[383,22051,22052,22055,22057,22059,22061,22063,22065,22067],{"class":19299,"line":19398},[383,22053,22054],{"class":19307},"y ",[383,22056,1567],{"class":19343},[383,22058,22025],{"class":19307},[383,22060,16861],{"class":19343},[383,22062,19441],{"class":19440},[383,22064,19982],{"class":19444},[383,22066,19441],{"class":19440},[383,22068,19469],{"class":19343},[383,22070,22071],{"class":19299,"line":19413},[383,22072,19370],{"emptyLinePlaceholder":1862},[383,22074,22075],{"class":19299,"line":19418},[383,22076,22077],{"class":20059},"# Train-test split: 80% for training, 20% for testing\n",[383,22079,22080,22083,22085,22088,22090,22093,22095,22098,22100,22103,22105,22107,22109,22111,22113,22116,22118,22121,22123,22126,22128,22130],{"class":19299,"line":19429},[383,22081,22082],{"class":19307},"X_train",[383,22084,1674],{"class":19343},[383,22086,22087],{"class":19307}," X_test",[383,22089,1674],{"class":19343},[383,22091,22092],{"class":19307}," y_train",[383,22094,1674],{"class":19343},[383,22096,22097],{"class":19307}," y_test ",[383,22099,1567],{"class":19343},[383,22101,22102],{"class":19307}," train_test_split",[383,22104,1933],{"class":19343},[383,22106,2515],{"class":19307},[383,22108,1674],{"class":19343},[383,22110,20519],{"class":19307},[383,22112,1674],{"class":19343},[383,22114,22115],{"class":20012}," test_size",[383,22117,1567],{"class":19343},[383,22119,22120],{"class":19391},"0.2",[383,22122,1674],{"class":19343},[383,22124,22125],{"class":20012}," random_state",[383,22127,1567],{"class":19343},[383,22129,19392],{"class":19391},[383,22131,19395],{"class":19343},[383,22133,22134],{"class":19299,"line":19472},[383,22135,19370],{"emptyLinePlaceholder":1862},[383,22137,22138,22141,22143,22146],{"class":19299,"line":19483},[383,22139,22140],{"class":19307},"coffee_shop_model ",[383,22142,1567],{"class":19343},[383,22144,22145],{"class":19307}," LinearRegression",[383,22147,20034],{"class":19343},[383,22149,22150,22153,22155,22158,22160,22162,22164,22166],{"class":19299,"line":19488},[383,22151,22152],{"class":19307},"coffee_shop_model",[383,22154,1497],{"class":19343},[383,22156,22157],{"class":19307},"fit",[383,22159,1933],{"class":19343},[383,22161,22082],{"class":19307},[383,22163,1674],{"class":19343},[383,22165,22092],{"class":19307},[383,22167,19395],{"class":19343},[383,22169,22170],{"class":19299,"line":19511},[383,22171,19370],{"emptyLinePlaceholder":1862},[383,22173,22174],{"class":19299,"line":19549},[383,22175,22176],{"class":20059},"# Make predictions on the test set\n",[383,22178,22179,22182,22184,22187,22189,22192,22194,22197],{"class":19299,"line":19584},[383,22180,22181],{"class":19307},"predictions ",[383,22183,1567],{"class":19343},[383,22185,22186],{"class":19307}," coffee_shop_model",[383,22188,1497],{"class":19343},[383,22190,22191],{"class":19307},"predict",[383,22193,1933],{"class":19343},[383,22195,22196],{"class":19307},"X_test",[383,22198,19395],{"class":19343},[299,22200,22202],{"id":22201},"step-5-evaluating-the-model","Step 5: Evaluating the Model",[11,22204,22205],{},"Now let's assess how \"accurate\" our algorithm is by comparing sales against its predictions.",[443,22207,22209],{"className":19292,"code":22208,"language":19294,"meta":451,"style":451},"mae = mean_absolute_error(y_test, predictions)\nrmse = np.sqrt(mean_squared_error(y_test, predictions))\nr2 = r2_score(y_test, predictions)\n\nprint(f\"MAE: ${mae:.2f}\")\nprint(f\"RMSE: ${rmse:.2f}\")\nprint(f\"R^2: {r2:.2f}\")\n",[404,22210,22211,22232,22261,22281,22285,22311,22335],{"__ignoreMap":451},[383,22212,22213,22216,22218,22220,22222,22225,22227,22230],{"class":19299,"line":19300},[383,22214,22215],{"class":19307},"mae ",[383,22217,1567],{"class":19343},[383,22219,21963],{"class":19307},[383,22221,1933],{"class":19343},[383,22223,22224],{"class":19307},"y_test",[383,22226,1674],{"class":19343},[383,22228,22229],{"class":19307}," predictions",[383,22231,19395],{"class":19343},[383,22233,22234,22237,22239,22241,22243,22246,22248,22251,22253,22255,22257,22259],{"class":19299,"line":1823},[383,22235,22236],{"class":19307},"rmse ",[383,22238,1567],{"class":19343},[383,22240,19841],{"class":19307},[383,22242,1497],{"class":19343},[383,22244,22245],{"class":19307},"sqrt",[383,22247,1933],{"class":19343},[383,22249,22250],{"class":19307},"mean_squared_error",[383,22252,1933],{"class":19343},[383,22254,22224],{"class":19307},[383,22256,1674],{"class":19343},[383,22258,22229],{"class":19307},[383,22260,20332],{"class":19343},[383,22262,22263,22266,22268,22271,22273,22275,22277,22279],{"class":19299,"line":1820},[383,22264,22265],{"class":19307},"r2 ",[383,22267,1567],{"class":19343},[383,22269,22270],{"class":19307}," r2_score",[383,22272,1933],{"class":19343},[383,22274,22224],{"class":19307},[383,22276,1674],{"class":19343},[383,22278,22229],{"class":19307},[383,22280,19395],{"class":19343},[383,22282,22283],{"class":19299,"line":1863},[383,22284,19370],{"emptyLinePlaceholder":1862},[383,22286,22287,22289,22291,22293,22296,22299,22302,22305,22307,22309],{"class":19299,"line":19354},[383,22288,20065],{"class":19500},[383,22290,1933],{"class":19343},[383,22292,2510],{"class":19690},[383,22294,22295],{"class":19444},"\"MAE: $",[383,22297,1930],{"class":22298},"sfsYZ",[383,22300,22301],{"class":19307},"mae",[383,22303,22304],{"class":19690},":.2f",[383,22306,2008],{"class":22298},[383,22308,19441],{"class":19444},[383,22310,19395],{"class":19343},[383,22312,22313,22315,22317,22319,22322,22324,22327,22329,22331,22333],{"class":19299,"line":19367},[383,22314,20065],{"class":19500},[383,22316,1933],{"class":19343},[383,22318,2510],{"class":19690},[383,22320,22321],{"class":19444},"\"RMSE: $",[383,22323,1930],{"class":22298},[383,22325,22326],{"class":19307},"rmse",[383,22328,22304],{"class":19690},[383,22330,2008],{"class":22298},[383,22332,19441],{"class":19444},[383,22334,19395],{"class":19343},[383,22336,22337,22339,22341,22343,22346,22348,22351,22353,22355,22357],{"class":19299,"line":19373},[383,22338,20065],{"class":19500},[383,22340,1933],{"class":19343},[383,22342,2510],{"class":19690},[383,22344,22345],{"class":19444},"\"R^2: ",[383,22347,1930],{"class":22298},[383,22349,22350],{"class":19307},"r2",[383,22352,22304],{"class":19690},[383,22354,2008],{"class":22298},[383,22356,19441],{"class":19444},[383,22358,19395],{"class":19343},[11,22360,22361],{},"Resulting in:",[11,22363,22364,22365],{},"MAE: ",[404,22366,22367],{},"$55.39",[11,22369,22370,22371],{},"RMSE: ",[404,22372,22373],{},"$74.51",[11,22375,22376,22438],{},[383,22377,22379,22397],{"className":22378},[1545],[383,22380,22382],{"className":22381},[1549],[1551,22383,22384],{"xmlns":1553},[1555,22385,22386,22394],{},[1558,22387,22388],{},[5068,22389,22390,22392],{},[1938,22391,278],{},[1561,22393,1563],{},[1569,22395,22396],{"encoding":1571},"R^2",[383,22398,22400],{"className":22399,"ariaHidden":1577},[1576],[383,22401,22403,22407],{"className":22402},[1581],[383,22404],{"className":22405,"style":22406},[1585],"height:0.8141em;",[383,22408,22410,22414],{"className":22409},[1590],[383,22411,278],{"className":22412,"style":22413},[1590,2033],"margin-right:0.0077em;",[383,22415,22417],{"className":22416},[2037],[383,22418,22420],{"className":22419},[2041],[383,22421,22423],{"className":22422},[2046],[383,22424,22426],{"className":22425,"style":22406},[2050],[383,22427,22429,22432],{"style":22428},"top:-3.063em;margin-right:0.05em;",[383,22430],{"className":22431,"style":2059},[2058],[383,22433,22435],{"className":22434},[2063,2064,2065,2066],[383,22436,1563],{"className":22437},[1590,2066],": 0.88",[11,22440,22441],{},"What do these numbers mean?",[34,22443,22444,22453,22462],{},[37,22445,22446,22449,22450,22452],{},[40,22447,22448],{},"MAE (Mean Absolute Error)",": On average, our predictions deviate from actual sales by approximately ",[404,22451,22367],{},". This gives us an idea of ​​the magnitude of the error in monetary terms.",[37,22454,22455,22458,22459,22461],{},[40,22456,22457],{},"RMSE (Mean Squared Error)",": By penalizing larger errors more, the RMSE of ",[404,22460,22373],{}," indicates that, although most predictions are close, there are some cases where the model is significantly off.",[37,22463,22464,22467],{},[40,22465,22466],{},"R² (Determination Score)",": An R² of 0.88 means that the model explains 88% of the variability in daily sales. This is a pretty good result, indicating that the model captures most of the patterns present in the data.",[11,22469,22470],{},[40,22471,22472],{},"Predictions vs. Actual Chart",[443,22474,22476],{"className":19292,"code":22475,"language":19294,"meta":451,"style":451},"plt.figure(figsize=(8,5))\nsns.scatterplot(x=y_test, y=predictions)\nplt.plot([y.min(), y.max()], [y.min(), y.max()], 'r--')  # Perfect reference line\nplt.title(\"Predictions vs Actual Sales\")\nplt.xlabel(\"Actual Sales ($)\")\nplt.ylabel(\"Model Predictions ($)\")\nplt.show()\n",[404,22477,22478,22500,22527,22590,22609,22628,22647],{"__ignoreMap":451},[383,22479,22480,22482,22484,22486,22488,22490,22492,22494,22496,22498],{"class":19299,"line":19300},[383,22481,20309],{"class":19307},[383,22483,1497],{"class":19343},[383,22485,20314],{"class":19307},[383,22487,1933],{"class":19343},[383,22489,20319],{"class":20012},[383,22491,20322],{"class":19343},[383,22493,20325],{"class":19391},[383,22495,1674],{"class":19343},[383,22497,9746],{"class":19391},[383,22499,20332],{"class":19343},[383,22501,22502,22504,22506,22508,22510,22512,22514,22516,22518,22520,22522,22525],{"class":19299,"line":1823},[383,22503,20337],{"class":19307},[383,22505,1497],{"class":19343},[383,22507,20502],{"class":19307},[383,22509,1933],{"class":19343},[383,22511,1940],{"class":20012},[383,22513,1567],{"class":19343},[383,22515,22224],{"class":19307},[383,22517,1674],{"class":19343},[383,22519,20519],{"class":20012},[383,22521,1567],{"class":19343},[383,22523,22524],{"class":19307},"predictions",[383,22526,19395],{"class":19343},[383,22528,22529,22531,22533,22536,22538,22540,22542,22545,22548,22550,22552,22555,22558,22560,22562,22564,22566,22568,22570,22572,22574,22576,22579,22582,22585,22587],{"class":19299,"line":1820},[383,22530,20309],{"class":19307},[383,22532,1497],{"class":19343},[383,22534,22535],{"class":19307},"plot",[383,22537,19600],{"class":19343},[383,22539,1950],{"class":19307},[383,22541,1497],{"class":19343},[383,22543,22544],{"class":19307},"min",[383,22546,22547],{"class":19343},"(),",[383,22549,20519],{"class":19307},[383,22551,1497],{"class":19343},[383,22553,22554],{"class":19307},"max",[383,22556,22557],{"class":19343},"()],",[383,22559,19437],{"class":19343},[383,22561,1950],{"class":19307},[383,22563,1497],{"class":19343},[383,22565,22544],{"class":19307},[383,22567,22547],{"class":19343},[383,22569,20519],{"class":19307},[383,22571,1497],{"class":19343},[383,22573,22554],{"class":19307},[383,22575,22557],{"class":19343},[383,22577,22578],{"class":19440}," '",[383,22580,22581],{"class":19444},"r--",[383,22583,22584],{"class":19440},"'",[383,22586,1955],{"class":19343},[383,22588,22589],{"class":20059},"  # Perfect reference line\n",[383,22591,22592,22594,22596,22598,22600,22602,22605,22607],{"class":19299,"line":1863},[383,22593,20309],{"class":19307},[383,22595,1497],{"class":19343},[383,22597,20400],{"class":19307},[383,22599,1933],{"class":19343},[383,22601,19441],{"class":19440},[383,22603,22604],{"class":19444},"Predictions vs Actual Sales",[383,22606,19441],{"class":19440},[383,22608,19395],{"class":19343},[383,22610,22611,22613,22615,22617,22619,22621,22624,22626],{"class":19299,"line":19354},[383,22612,20309],{"class":19307},[383,22614,1497],{"class":19343},[383,22616,20420],{"class":19307},[383,22618,1933],{"class":19343},[383,22620,19441],{"class":19440},[383,22622,22623],{"class":19444},"Actual Sales ($)",[383,22625,19441],{"class":19440},[383,22627,19395],{"class":19343},[383,22629,22630,22632,22634,22636,22638,22640,22643,22645],{"class":19299,"line":19367},[383,22631,20309],{"class":19307},[383,22633,1497],{"class":19343},[383,22635,20440],{"class":19307},[383,22637,1933],{"class":19343},[383,22639,19441],{"class":19440},[383,22641,22642],{"class":19444},"Model Predictions ($)",[383,22644,19441],{"class":19440},[383,22646,19395],{"class":19343},[383,22648,22649,22651,22653,22655],{"class":19299,"line":19373},[383,22650,20309],{"class":19307},[383,22652,1497],{"class":19343},[383,22654,20460],{"class":19307},[383,22656,20034],{"class":19343},[11,22658,22659,22663],{},[80,22660],{"alt":22661,"src":22662},"Predictions vs Actual","\u002Fblog\u002Fexperimenting-with-exploratory-data-analysis\u002Fshared\u002Fpredictions_vs_actual_sales.webp",[85,22664,22665],{},"Predictions vs. Actual Sales",[11,22667,22668],{},"As we can see, we have a reference line (in red) that represents perfection: if all predictions were exactly on that line, the model would be perfect, but reality will never be that ideal. However, most points are grouped around that line, indicating that the model has a good overall performance. Some points are further away, reflecting cases where the model does not predict as well, possibly due to factors not captured in the dataset or inherent variability in daily sales.",[11,22670,22671],{},"We can also obtain the coefficients of the model to understand the importance of each variable:",[443,22673,22675],{"className":19292,"code":22674,"language":19294,"meta":451,"style":451},"coefficients = pd.DataFrame({\n    'Feature': X.columns,\n    'Coefficient': coffee_shop_model.coef_\n})\ndisplay(coefficients.sort_values(by='Coefficient', ascending=False))\n",[404,22676,22677,22693,22715,22733,22738],{"__ignoreMap":451},[383,22678,22679,22682,22684,22686,22688,22690],{"class":19299,"line":19300},[383,22680,22681],{"class":19307},"coefficients ",[383,22683,1567],{"class":19343},[383,22685,19997],{"class":19307},[383,22687,1497],{"class":19343},[383,22689,20002],{"class":19307},[383,22691,22692],{"class":19343},"({\n",[383,22694,22695,22698,22701,22703,22705,22708,22710,22712],{"class":19299,"line":1823},[383,22696,22697],{"class":19440},"    '",[383,22699,22700],{"class":19444},"Feature",[383,22702,22584],{"class":19440},[383,22704,1173],{"class":19343},[383,22706,22707],{"class":19307}," X",[383,22709,1497],{"class":19343},[383,22711,20018],{"class":19307},[383,22713,22714],{"class":19343},",\n",[383,22716,22717,22719,22722,22724,22726,22728,22730],{"class":19299,"line":1820},[383,22718,22697],{"class":19440},[383,22720,22721],{"class":19444},"Coefficient",[383,22723,22584],{"class":19440},[383,22725,1173],{"class":19343},[383,22727,22186],{"class":19307},[383,22729,1497],{"class":19343},[383,22731,22732],{"class":19307},"coef_\n",[383,22734,22735],{"class":19299,"line":1863},[383,22736,22737],{"class":19343},"})\n",[383,22739,22740,22743,22745,22748,22750,22753,22755,22758,22760,22762,22764,22766,22768,22771,22773,22776],{"class":19299,"line":19354},[383,22741,22742],{"class":19307},"display",[383,22744,1933],{"class":19343},[383,22746,22747],{"class":19307},"coefficients",[383,22749,1497],{"class":19343},[383,22751,22752],{"class":19307},"sort_values",[383,22754,1933],{"class":19343},[383,22756,22757],{"class":20012},"by",[383,22759,1567],{"class":19343},[383,22761,22584],{"class":19440},[383,22763,22721],{"class":19444},[383,22765,22584],{"class":19440},[383,22767,1674],{"class":19343},[383,22769,22770],{"class":20012}," ascending",[383,22772,1567],{"class":19343},[383,22774,22775],{"class":19303},"False",[383,22777,20332],{"class":19343},[11,22779,22780],{},"This gives us the following result:",[836,22782,22783,22791],{},[839,22784,22785],{},[842,22786,22787,22789],{},[845,22788,22700],{},[845,22790,22721],{},[854,22792,22793,22800,22808,22815,22822,22829,22837],{},[842,22794,22795,22797],{},[859,22796,19955],{},[859,22798,22799],{},"261.839739",[842,22801,22802,22805],{},[859,22803,22804],{},"weather_Rainy",[859,22806,22807],{},"124.573377",[842,22809,22810,22812],{},[859,22811,19964],{},[859,22813,22814],{},"4.837618",[842,22816,22817,22819],{},[859,22818,19946],{},[859,22820,22821],{},"2.482678",[842,22823,22824,22826],{},[859,22825,19937],{},[859,22827,22828],{},"-8.578684",[842,22830,22831,22834],{},[859,22832,22833],{},"weather_Cloudy",[859,22835,22836],{},"-28.151991",[842,22838,22839,22842],{},[859,22840,22841],{},"weather_Sunny",[859,22843,22844],{},"-96.421386",[11,22846,22847],{},"This tells us the impact of each variable on daily sales, holding the others constant. For example:",[34,22849,22850,22856,22862,22869,22875,22881,22887],{},[37,22851,22852,22853,1497],{},"A local event (local_event) increases sales by approximately ",[404,22854,22855],{},"$261.84",[37,22857,22858,22859,1497],{},"A rainy day (weather_Rainy) increases sales by approximately ",[404,22860,22861],{},"$124.57",[37,22863,22864,22865,22868],{},"A discount (discount) increases sales by approximately ",[404,22866,22867],{},"$4.84"," for each percentage point of discount.",[37,22870,22871,22872,1497],{},"Each additional dollar invested in advertising (ad_investment) increases sales by approximately ",[404,22873,22874],{},"$2.48",[37,22876,22877,22878,1497],{},"Each additional degree Celsius (temperature_c) decreases sales by approximately ",[404,22879,22880],{},"$8.58",[37,22882,22883,22884,1497],{},"A cloudy day (weather_Cloudy) decreases sales by approximately ",[404,22885,22886],{},"$28.15",[37,22888,22889,22890,1497],{},"A sunny day (weather_Sunny) decreases sales by approximately ",[404,22891,22892],{},"$96.42",[11,22894,22895],{},"What improvements can we make to the model?",[34,22897,22898,22913,22919,22928,22934],{},[37,22899,22900,22902,22903,72,22905,22907,22908,72,22910,22912],{},[40,22901,1331],{},": Explore the creation of new features from existing ones. For example, interaction terms between ",[404,22904,19946],{},[404,22906,19964],{},", or ",[404,22909,19937],{},[404,22911,19973],{},", could capture more complex relationships.",[37,22914,22915,22918],{},[40,22916,22917],{},"Non-linear Relationships",": The current model is linear. If scatter plots suggest non-linear relationships (e.g., sales reaching a maximum at a certain temperature and then decreasing), polynomial features or other non-linear models (such as Random Forest or Gradient Boosting) could capture them better.",[37,22920,22921,22924,22925,22927],{},[40,22922,22923],{},"Temporal Aspects",": Since the data is daily sales, there might be temporal patterns (e.g., weekday effects, seasonality not fully captured by ",[404,22926,19973],{},"). Incorporating features like the day of the week, month, or using specific time series models could be beneficial.",[37,22929,22930,22933],{},[40,22931,22932],{},"Outlier Detection",": Investigate any potential outliers in the data that might be disproportionately influencing the model's coefficients and predictions.",[37,22935,22936,22939],{},[40,22937,22938],{},"More Data",": While not always feasible, having a more diverse dataset (e.g., from different coffee shops, over a longer period, and with more varied conditions) could help the model generalize better.",[22941,22942,22943],"style",{},"html .default .shiki span {color: var(--shiki-default);background: var(--shiki-default-bg);font-style: var(--shiki-default-font-style);font-weight: var(--shiki-default-font-weight);text-decoration: var(--shiki-default-text-decoration);}html .shiki span {color: var(--shiki-default);background: var(--shiki-default-bg);font-style: var(--shiki-default-font-style);font-weight: var(--shiki-default-font-weight);text-decoration: var(--shiki-default-text-decoration);}html .dark .shiki span {color: var(--shiki-dark);background: var(--shiki-dark-bg);font-style: var(--shiki-dark-font-style);font-weight: var(--shiki-dark-font-weight);text-decoration: var(--shiki-dark-text-decoration);}html.dark .shiki span {color: var(--shiki-dark);background: var(--shiki-dark-bg);font-style: var(--shiki-dark-font-style);font-weight: var(--shiki-dark-font-weight);text-decoration: var(--shiki-dark-text-decoration);}html pre.shiki code .sTPum, html code.shiki .sTPum{--shiki-default:#1E754F;--shiki-dark:#4D9375}html pre.shiki code .s8w-G, html code.shiki .s8w-G{--shiki-default:#393A34;--shiki-dark:#DBD7CAEE}html pre.shiki code .si6no, html code.shiki .si6no{--shiki-default:#999999;--shiki-dark:#666666}html pre.shiki code .sqbOQ, html code.shiki .sqbOQ{--shiki-default:#2F798A;--shiki-dark:#4C9A91}html pre.shiki code .scnC2, html code.shiki .scnC2{--shiki-default:#B5695977;--shiki-dark:#C98A7D77}html pre.shiki code .spP0B, html code.shiki .spP0B{--shiki-default:#B56959;--shiki-dark:#C98A7D}html pre.shiki code .sHLBJ, html code.shiki .sHLBJ{--shiki-default:#998418;--shiki-dark:#B8A965}html pre.shiki code .s5TCs, html code.shiki .s5TCs{--shiki-default:#AB5959;--shiki-dark:#CB7676}html pre.shiki code .s9nN2, html code.shiki .s9nN2{--shiki-default:#B07D48;--shiki-dark:#BD976A}html pre.shiki code .snYqZ, html code.shiki .snYqZ{--shiki-default:#A0ADA0;--shiki-dark:#758575DD}html pre.shiki code .sfsYZ, html code.shiki .sfsYZ{--shiki-default:#A65E2B;--shiki-dark:#C99076}",{"title":451,"searchDepth":1820,"depth":1820,"links":22945},[22946],{"id":19254,"depth":1823,"text":19255,"children":22947},[22948,22949,22950,22951,22952],{"id":19273,"depth":1820,"text":19274},{"id":20037,"depth":1820,"text":20038},{"id":20270,"depth":1820,"text":20271},{"id":21900,"depth":1820,"text":21901},{"id":22201,"depth":1820,"text":22202},"2026-04-19","\u002Fblog\u002Fexperimenting-with-exploratory-data-analysis\u002Fshared\u002Feda.webp",{},"\u002Fblog\u002Fblog\u002Fexperimenting-with-exploratory-data-analysis",{"title":19235,"description":19240},{"loc":22959,"priority":1868,"lastmod":22953},"\u002Fblog\u002Fexperimenting-with-exploratory-data-analysis","experimenting-with-exploratory-data-analysis","blog\u002Fblog\u002Fexperimenting-with-exploratory-data-analysis","In this article, we will explore the process of exploratory data analysis (EDA) in the context of machine learning projects.",[22964,22965,22966,22967,22968],"machine learning","data analysis","EDA","machine learning projects","exploratory analysis","4CGVb8074X-ES3BcsMtHLKlQN-4SeiuxoecVy_h3QjE",1776805793326]