{"id":2127,"date":"2020-08-01T01:01:00","date_gmt":"2020-08-01T01:01:00","guid":{"rendered":"https:\/\/library.iiap.res.in\/collaborate\/?p=2127"},"modified":"2025-06-09T07:20:59","modified_gmt":"2025-06-09T07:20:59","slug":"errors-are-beautiful-and-gaussian-really","status":"publish","type":"post","link":"https:\/\/library.iiap.res.in\/collaborate\/?p=2127","title":{"rendered":"\u201cErrors are beautiful and Gaussian\u201d-Really?"},"content":{"rendered":"\n<p class=\"has-theme-palette-1-color has-text-color\" style=\"font-size:20px\"><strong>Soumya Sengupta<\/strong><\/p>\n\n\n\n<p>Gaussian or Normal Distribution is the most common of all the probability distributions in the sense that the heights of the boys in a classroom, the errors in any experiments, or the probability of acceptance of your proposal (in your company or in love affairs) all follow the Gaussian distribution. <span style=\"box-sizing: border-box; margin: 0px; padding: 0px;\">De Moivre\u00a0first reported the Gaussian distribution, and Sir Gauss worked for its development.<\/span><\/p>\n\n\n\n<p>The Gaussian distribution function has the following mathematical form,<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full is-resized\"><img decoding=\"async\" loading=\"lazy\" src=\"https:\/\/library.iiap.res.in\/collaborate\/wp-content\/uploads\/2024\/12\/Screenshot-from-2024-12-06-15-59-43.png\" alt=\"\" class=\"wp-image-2812\" width=\"474\" height=\"117\" srcset=\"https:\/\/library.iiap.res.in\/collaborate\/wp-content\/uploads\/2024\/12\/Screenshot-from-2024-12-06-15-59-43.png 535w, https:\/\/library.iiap.res.in\/collaborate\/wp-content\/uploads\/2024\/12\/Screenshot-from-2024-12-06-15-59-43-300x74.png 300w\" sizes=\"(max-width: 474px) 100vw, 474px\" \/><\/figure><\/div>\n\n\n<p>where,<\/p>\n\n\n\n<ol>\n<li><em>\u00b5 <\/em>is the mean value or the expectation value of the probability distribution i.e. the probability of finding the variable x in this distribution is maximum at <em>\u00b5<\/em><\/li>\n\n\n\n<li><em>\u03c3 <\/em>is the standard deviation of the distribution.<\/li>\n<\/ol>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter is-resized\"><img decoding=\"async\" loading=\"lazy\" src=\"https:\/\/lh7-us.googleusercontent.com\/8Fg4K_fiAzuelixZmZA5EhPT4aYziuqBhHZXdO5PnaBd_o32NrohKExaQ1XKc8pFUA6ok1xlMF0Ef4AAa9chlhUwqmu_ARy9I7vyW5CgRDdAs9Aetl1jCcBiiDr28oiUmRoJSRsdlj5XfLyMiU7evQ\" alt=\"\" width=\"612\" height=\"459\"\/><\/figure><\/div>\n\n\n<p>Here in figure 1, you can see the bell-shaped structure of the Gaussian distribution function. The probability is clearly maximum at <em>\u00b5 <\/em>= 2.<\/p>\n\n\n\n<p>Now I will show practically how we can get Gaussian distribution in an experiment<strong>:<\/strong><\/p>\n\n\n\n<p>Suppose, I toss an unbiased coin (For an unbiased coin the probability of getting\u201d Head\u201d or\u201d Tail\u201d is exactly the same) <em>N <\/em>number of times. As the coin is unbiased, we expect there is a high probability of getting an equal number of head and tail, provided N is large. How large? Suppose N=10. Then obviously the probability of getting an equal number of heads and tails is very less. Now if we plot it in a graph and check how many heads or tails are there for N number of tosses, let\u2019s assign \u201d+1\u201d with head and \u201d-1\u201d with a tail. So, after N number of tosses if we add all these assigned values then the sum should be equal to zero (as the probability of getting Head and Tail is equal). As we expect the sum of this assigned value is zero so technically the mean or expectation value for this experiment is zero.<\/p>\n\n\n\n<p>Now if we perform this same experiment for <em>M <\/em>number<em> <\/em>of coins then the sum will not be always equal to zero (obviously, right?). So, what will be the minimum and maximum value of this sum for N=10 number of tosses? If all outcomes are \u2019tail\u2019 then the sum S=-10 (which is minimum) and when all are \u2019head\u2019 then S=10 (maximum). Therefore, in one sentence,<\/p>\n\n\n\n<p>For N number of tosses, the minimum value of the sum of assigned values is -N and the maximum is N while the assigned values are \u00b11.<\/p>\n\n\n\n<p>Now we can think about M which is the number of coins to do the experiment. If we do this tossing with really large (how large? Suppose M=10,000) number of coins and plot the histogram of those summed values we will get the following graphs.<\/p>\n\n\n\n<div class=\"is-layout-flex wp-container-3 wp-block-columns\">\n<div class=\"is-layout-flow wp-block-column\">\n<p><img decoding=\"async\" src=\"https:\/\/lh7-us.googleusercontent.com\/CYPqkRwvnBSBlKgb-7HWhVWcZAcHAcgWrTDQcQYrz8BYeBiN_HqERG8-k5lUiEB-CkEwlus27hIL3OzcA2woa1iAZ3lvpdlAYCdiQWeKJyYsoME-JiOY9_EmKQinDcrlyWncMcSBA-cdG13T2FhHNvc\" style=\"width: 1000px;\"><\/p>\n\n\n\n<p class=\"has-text-align-center\">(a) With \u00b11 assigned value<\/p>\n<\/div>\n\n\n\n<div class=\"is-layout-flow wp-block-column\">\n<p class=\"has-text-align-center\"><img decoding=\"async\" src=\"https:\/\/lh7-us.googleusercontent.com\/ENWDvF4A4ynuCIgSiZHUB0uJh5-cDjWVwb1F1jw1bGF-04mL5QffWHzEKrS0MEiaVDFEZHuHKcPJ4hiAOcjbok7Ala-BSPL7LbWEoY6daqs8qQ-Uy3v35-6HEH6YfZ4F9nSuHzjjbxKCk8nOviukJ3M\" style=\"width: 1000px;\"><\/p>\n\n\n\n<p class=\"has-text-align-center\">(b) With random assigned value<br><\/p>\n<\/div>\n<\/div>\n\n\n\n<p class=\"has-text-align-center\"><em>Figure 2: Histogram plot of the sum of assigned values of the coin-tossing experiment at N=10 and M=10,000. See, it takes a Gaussian shape.<\/em><br><\/p>\n\n\n\n<p>From Figure (2a) it is clear that when M is large (10,000) then the histogram looks like a gaussian. But the bar-like structure is due to the integer sums. If we replace that \u201c+1\u201d or \u201c-1\u201d steps by some random numbers between -1 to 1 then the diagram will change its shape as Figure (2b). In Figure (2b) we can observe that the maximum and minimum of the summed values changes from \u00b1N. This is because the assigned random numbers are in between -1 and 1.<\/p>\n\n\n\n<p>Let\u2019s progress further in this experiment. We can now fix the number of coins (i.e. M=10,000) and increase the value of N from 10 to 100, 1000, and so on. Then the histogram will change as shown in figure 3.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter\"><img decoding=\"async\" src=\"https:\/\/lh7-us.googleusercontent.com\/AKTytxRmeXeKotI-oZZPlvGcCL9nSWHuQ1bT_Ss50kXQaW8e0ZGGdlfE82MuPxjWXNS2554QOoC5qw6aw0lO7Dwxq01OzeAvIPU-QkrCfTBZhzNUMmMmehziQVTv__zqQ1WM7cpm2bQiN6lf4NO3jw\" alt=\"\"\/><figcaption class=\"wp-element-caption\"><em>Figure 3: Histogram for various values of N<\/em><\/figcaption><\/figure><\/div>\n\n\n<p>Thus, by increasing the number of tossing in this experiment we will get sharper and sharper Gaussian.<\/p>\n\n\n\n<p>Now, it\u2019s time to conclude this experiment and give some predictions with logical intuition.<\/p>\n\n\n\n<ol>\n<li>If we increase the number of tosses (i.e. N) with a fixed number of coins (i.e. M fixed), then the sharpness of the histogram will increase. So, if we increase N infinitely the Gaussian will become a delta function (Ohh really! You can think about it.) (Here the delta function distribution means that the probability is fixed at a particular point.)<\/li>\n\n\n\n<li>One more thing to note is that the height of the Gaussian is directly proportional to N (i.e. number of tossing) while the flatness is inversely proportional to N for constant M.<\/li>\n\n\n\n<li>Whatever be the value of M (i.e. number of coins) or N, the shape of the Gaussian remains the same. Look how beautiful the errors are! They are always symmetric on both sides from the mean, irrespective of where the mean is.<\/li>\n<\/ol>\n\n\n\n<p>In this note, I have discussed a little about the starting point of a Gaussian distribution. You can think more, play more, and have more fun.<\/p>\n\n\n\n<p class=\"has-text-align-center has-theme-palette-1-color has-text-color has-background\" style=\"background-color:#edf5e4\"><strong>About the author<\/strong><br><strong>Soumya Sengupta<\/strong> is a Senior Research Fellow at IIA and he works on modelling of Exoplanet atmosphere.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Soumya Sengupta Gaussian or Normal Distribution is the most common of all the probability distributions in the sense that the heights of the boys in a classroom, the errors in any experiments, or the probability of acceptance of your proposal (in your company or in love affairs) all follow the Gaussian distribution. De Moivre\u00a0first reported&#8230;<\/p>\n","protected":false},"author":5,"featured_media":2333,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_kad_post_transparent":"","_kad_post_title":"","_kad_post_layout":"","_kad_post_sidebar_id":"","_kad_post_content_style":"","_kad_post_vertical_padding":"","_kad_post_feature":"","_kad_post_feature_position":"","_kad_post_header":false,"_kad_post_footer":false},"categories":[24,87],"tags":[],"_links":{"self":[{"href":"https:\/\/library.iiap.res.in\/collaborate\/index.php?rest_route=\/wp\/v2\/posts\/2127"}],"collection":[{"href":"https:\/\/library.iiap.res.in\/collaborate\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/library.iiap.res.in\/collaborate\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/library.iiap.res.in\/collaborate\/index.php?rest_route=\/wp\/v2\/users\/5"}],"replies":[{"embeddable":true,"href":"https:\/\/library.iiap.res.in\/collaborate\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=2127"}],"version-history":[{"count":20,"href":"https:\/\/library.iiap.res.in\/collaborate\/index.php?rest_route=\/wp\/v2\/posts\/2127\/revisions"}],"predecessor-version":[{"id":3213,"href":"https:\/\/library.iiap.res.in\/collaborate\/index.php?rest_route=\/wp\/v2\/posts\/2127\/revisions\/3213"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/library.iiap.res.in\/collaborate\/index.php?rest_route=\/wp\/v2\/media\/2333"}],"wp:attachment":[{"href":"https:\/\/library.iiap.res.in\/collaborate\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=2127"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/library.iiap.res.in\/collaborate\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=2127"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/library.iiap.res.in\/collaborate\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=2127"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}