{"id":9042,"date":"2021-04-25T21:34:20","date_gmt":"2021-04-25T21:34:20","guid":{"rendered":"https:\/\/www.particlebites.com\/?p=9042"},"modified":"2021-05-09T20:54:22","modified_gmt":"2021-05-09T20:54:22","slug":"new-detectors-on-the-block","status":"publish","type":"post","link":"https:\/\/www.particlebites.com\/?p=9042","title":{"rendered":"New detectors on the block"},"content":{"rendered":"<p align=\"justify\"><strong>Article title:<\/strong> \u201cToward Machine Learning Optimization of Experimental Design\u201d<\/p>\n<p align=\"justify\"><strong>Authors:<\/strong> MODE Collaboration<\/p>\n<p align=\"justify\"><strong>Reference:<\/strong> <a href=\"https:\/\/inspirehep.net\/literature\/1850892\" target=\"_blank\" rel=\"noopener\">https:\/\/inspirehep.net\/literature\/1850892<\/a> (<a href=\"https:\/\/mode-collaboration.github.io\/docs\/mode_npni_preprint.pdf\" target=\"_blank\" rel=\"noopener\">pdf<\/a>)<\/p>\n<p align=\"justify\">In a <a href=\"https:\/\/www.particlebites.com\/?p=7528\">previous post<\/a> we wondered if (machine learning) algorithms can replace the entire simulation of detectors and reconstruction of particles. But meanwhile some experimentalists have gone one step further \u2013 and wondered if algorithms can <i>design <\/i>detectors.<\/p>\n<p align=\"justify\">Indeed, the MODE collaboration stands for Machine-learning Optimized Design of Experiments and in its first paper promises nothing less than that.<\/p>\n<p align=\"justify\">The idea here is that the choice of characteristics that an experiment can have is vast (think number of units, materials, geometry, dimensions and so on), but its ultimate goal can still be described by a single \u201cutility function\u201d. For instance, the precision of the measurement on specific data can be thought of as a utility function.<\/p>\n<p align=\"justify\">Then, the whole process that leads to obtaining that function can be decomposed into a number of conceptual blocks: normally there are incoming particles, which move through and interact with detectors, resulting in measurements; from them, the characteristics of the particles are reconstructed; these are eventually analyzed to get relevant useful quantities, the <span lang=\"en-US\">utility function among them. Ultimately, chaining together these blocks creates a pipeline that models the experiment from one end to the other. <\/span><\/p>\n<p align=\"justify\"><span lang=\"en-US\">Now, <\/span><span lang=\"en-US\">another<\/span><span lang=\"en-US\"> central notion is differentiation or, rather, the ability to be differentiated; if all the components of this model are differentiable, then the gradient of the utility function can be calculated. This leads to the holy grail: finding its extreme values, i.e. optimize the experiment\u2019s design as a function of its numerous components. <\/span><\/p>\n<p align=\"justify\">Before we see whether the components are indeed differentiable and how the gradient gets calculated, here is an example of this pipeline concept for a muon radiography detector.<\/p>\n<figure id=\"attachment_9044\" aria-describedby=\"caption-attachment-9044\" style=\"width: 300px\" class=\"wp-caption alignright\"><a href=\"https:\/\/www.particlebites.com\/wp-content\/uploads\/2021\/04\/pic1.png\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-9044 size-medium\" src=\"https:\/\/www.particlebites.com\/wp-content\/uploads\/2021\/04\/pic1-300x234.png\" alt=\"\" width=\"300\" height=\"234\" srcset=\"https:\/\/www.particlebites.com\/wp-content\/uploads\/2021\/04\/pic1-300x234.png 300w, https:\/\/www.particlebites.com\/wp-content\/uploads\/2021\/04\/pic1.png 700w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/a><figcaption id=\"caption-attachment-9044\" class=\"wp-caption-text\">Discovering a hidden space in the Great Pyramid by using muons. <em>( <a href=\"https:\/\/www.ft.com\/content\/6c9a2bee-bf27-11e7-9836-b25f8adaa111\" target=\"_blank\" rel=\"noopener\">Financial Times<\/a>)<\/em><\/figcaption><\/figure>\n<p align=\"justify\">Muons are not just the trendy star of particle physics (as of April 2021), but they also find application in scanning closed volumes and revealing details about the objects in them. And yes, the Great Pyramid has been muographed <a href=\"https:\/\/www.nature.com\/articles\/nature24647\">successfully<\/a>.<\/p>\n<p align=\"justify\">In terms of the pipeline described above, a muon radiography device could be modeled in the following way: Muons from cosmic rays are generated in the form of 4-vectors. Those are fed to a fast-simulation of the scanned volume and the detector. The interactions of the particles with the materials and the resulting signals on the electronics are simulated. This output goes into a reconstruction module, which recreates muon tracks. From them, an information-extraction module calculates the density of the scanned material. It can also produce a loss function for the measurement, which here would be the target quantity.<\/p>\n<figure id=\"attachment_9043\" aria-describedby=\"caption-attachment-9043\" style=\"width: 700px\" class=\"wp-caption aligncenter\"><a href=\"https:\/\/www.particlebites.com\/wp-content\/uploads\/2021\/04\/pic2.png\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-9043\" src=\"https:\/\/www.particlebites.com\/wp-content\/uploads\/2021\/04\/pic2-300x168.png\" alt=\"\" width=\"700\" height=\"393\" srcset=\"https:\/\/www.particlebites.com\/wp-content\/uploads\/2021\/04\/pic2-300x168.png 300w, https:\/\/www.particlebites.com\/wp-content\/uploads\/2021\/04\/pic2-768x431.png 768w, https:\/\/www.particlebites.com\/wp-content\/uploads\/2021\/04\/pic2.png 984w\" sizes=\"auto, (max-width: 700px) 100vw, 700px\" \/><\/a><figcaption id=\"caption-attachment-9043\" class=\"wp-caption-text\">Conceptual layout of the optimization pipeline. <em>(<a href=\"https:\/\/mode-collaboration.github.io\/#papers\" target=\"_blank\" rel=\"noopener\">MODE collaboration<\/a>)<\/em><\/figcaption><\/figure>\n<p align=\"justify\">This whole ritual is a standard process in experimental work, although the steps are usually quite separate from one another. In the MODE concept, however, not only are they linked together but also run <i>iteratively.<\/i> The optimization of the detector design proceeds in steps and in each of them the parameters of the device are changed in the simulation. This affects directly the detector module and indirectly the downstream modules of the pipeline. The loop of modification and validation can be constrained appropriately to keep everything within realistic values, and also to make the most important consideration of all enter the game \u2013 that is of course cost and the constraints that it brings along.<\/p>\n<figure id=\"attachment_9054\" aria-describedby=\"caption-attachment-9054\" style=\"width: 300px\" class=\"wp-caption alignright\"><a href=\"https:\/\/www.particlebites.com\/wp-content\/uploads\/2021\/04\/featured_huf8623e3651292c46251c2f19af84c2fd_651010_720x0_resize_lanczos_2.png\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-9054 size-medium\" src=\"https:\/\/www.particlebites.com\/wp-content\/uploads\/2021\/04\/featured_huf8623e3651292c46251c2f19af84c2fd_651010_720x0_resize_lanczos_2-300x229.png\" alt=\"\" width=\"300\" height=\"229\" srcset=\"https:\/\/www.particlebites.com\/wp-content\/uploads\/2021\/04\/featured_huf8623e3651292c46251c2f19af84c2fd_651010_720x0_resize_lanczos_2-300x229.png 300w, https:\/\/www.particlebites.com\/wp-content\/uploads\/2021\/04\/featured_huf8623e3651292c46251c2f19af84c2fd_651010_720x0_resize_lanczos_2.png 720w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/a><figcaption id=\"caption-attachment-9054\" class=\"wp-caption-text\">Descending towards the minimum. <em>(<a href=\"https:\/\/halfrost.me\/post\/how-to-understand-gradient-descent\/\" target=\"_blank\" rel=\"noopener\">Dezhi Yu<\/a>) <\/em><\/figcaption><\/figure>\n<p align=\"justify\">As mentioned above, the proposed optimization proceeds in steps by optimizing the parameters along the gradient of the utility function. The most famous incarnation of gradient-based optimization is gradient descent which is customarily used in neural networks. Gradient descent guides the network towards the minimum value of the error that it produces, through the possible &#8220;paths&#8221; of its parameters.<\/p>\n<p align=\"justify\">In the MODE proposal the optimization is achieved through automatic differentiation (AD), the latest word in the calculation of derivatives in computer programs. To shamefully paraphrase <a href=\"https:\/\/en.wikipedia.org\/wiki\/Automatic_differentiation\">Wikipedia<\/a>, AD exploits the fact that every computer program, no matter how complicated, executes a sequence of elementary arithmetic operations and functions. By applying the chain rule repeatedly to these operations, derivatives can be computed automatically, accurately and efficiently.<\/p>\n<p align=\"justify\">Also, something was mentioned above about whether the components of the pipeline are \u201cindeed differentiable\u201d. It turns out that one isn\u2019t. This is the simulation of the processes during the passage of particles through the detector, which is stochastic by nature. However, machine learning can learn how to mimic it, take its place, and provide perfectly fine and differentiable modules. (The brave of heart can follow the link at the end to find out about local generative surrogates.)<\/p>\n<p align=\"justify\"><span style=\"font-size: medium\">T<\/span><span style=\"font-size: medium\">his method of designing detectors might sound like a thought experiment on steroids. But the point of MODE is that it&#8217;s the realistic way to take full advantage of the current developments in computation. And maybe to feel like we have really entered the third century of particle experiments.<br \/>\n<\/span><\/p>\n<p align=\"justify\"><strong>Further reading:<\/strong><\/p>\n<p align=\"justify\"><span style=\"font-size: medium\">T<\/span><span style=\"font-size: medium\">he MODE website: <a href=\"https:\/\/mode-collaboration.github.io\/\">https:\/\/mode-collaboration.github.io\/<\/a> <\/span><\/p>\n<p align=\"justify\"><span style=\"font-size: medium\">A Beginner&#8217;s Guide to Differentiable Programming: <a href=\"https:\/\/wiki.pathmind.com\/differentiableprogramming\">https:\/\/wiki.pathmind.com\/differentiableprogramming<\/a> <\/span><\/p>\n<p align=\"left\"><span style=\"font-size: medium\">Black-Box Optimization with Local Generative Surrogates: <a href=\"https:\/\/arxiv.org\/abs\/2002.04632\">https:\/\/arxiv.org\/abs\/2002.04632<\/a> <\/span><\/p>\n<p align=\"left\">\n","protected":false},"excerpt":{"rendered":"<p>Article title: \u201cToward Machine Learning Optimization of Experimental Design\u201d Authors: MODE Collaboration Reference: https:\/\/inspirehep.net\/literature\/1850892 (pdf) In a previous post we wondered if (machine learning) algorithms can replace the entire simulation of detectors and reconstruction of particles. But meanwhile some experimentalists have gone one step further \u2013 and wondered if algorithms can design detectors. Indeed, the &hellip; <\/p>\n<p class=\"link-more\"><a href=\"https:\/\/www.particlebites.com\/?p=9042\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;New detectors on the block&#8221;<\/span><\/a><\/p>\n","protected":false},"author":31,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[57],"tags":[21,74,49],"class_list":["post-9042","post","type-post","status-publish","format-standard","hentry","category-experimental-techniques","tag-experiment","tag-machine-learning","tag-particle-physics"],"_links":{"self":[{"href":"https:\/\/www.particlebites.com\/index.php?rest_route=\/wp\/v2\/posts\/9042","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.particlebites.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.particlebites.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.particlebites.com\/index.php?rest_route=\/wp\/v2\/users\/31"}],"replies":[{"embeddable":true,"href":"https:\/\/www.particlebites.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=9042"}],"version-history":[{"count":16,"href":"https:\/\/www.particlebites.com\/index.php?rest_route=\/wp\/v2\/posts\/9042\/revisions"}],"predecessor-version":[{"id":9171,"href":"https:\/\/www.particlebites.com\/index.php?rest_route=\/wp\/v2\/posts\/9042\/revisions\/9171"}],"wp:attachment":[{"href":"https:\/\/www.particlebites.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=9042"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.particlebites.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=9042"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.particlebites.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=9042"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}