{"id":181,"date":"2017-08-02T01:40:38","date_gmt":"2017-08-02T01:40:38","guid":{"rendered":"http:\/\/sigai.acm.org\/aimatters\/blog\/?p=181"},"modified":"2017-08-02T01:43:44","modified_gmt":"2017-08-02T01:43:44","slug":"algorithms-and-algorithmic-transparency","status":"publish","type":"post","link":"https:\/\/sigai.acm.org\/aimatters\/blog\/2017\/08\/02\/algorithms-and-algorithmic-transparency\/","title":{"rendered":"Algorithms and Algorithmic Transparency"},"content":{"rendered":"<p>Our July 15th post summarized the\u00a0<a href=\"http:\/\/www.acm.org\/binaries\/content\/assets\/public-policy\/2017_joint_statement_algorithms.pdf\">USACM-EUACM joint statement<\/a>\u00a0on Algorithmic Transparency and Accountability (ATA) and introduced the ATA FAQ project by the USACM Algorithms Working Group. Their goal is \u201cto take the lead addressing the technical aspects of algorithms and to have content prepared for media inquiries and policymakers.\u201d The SIGAI has been asked to contribute expertise in developing content for the FAQ. Please comment to this posting so we can collect and share insights with USACM. You can also send your ideas and suggestion directly to Cynthia Florentino, ACM Policy Analyst, at <a href=\"mailto:cflorentino@acm.org\">cflorentino@acm.org<\/a>.<\/p>\n<p>The focus of this post is the discussion of \u201calgorithms\u201d in the FAQ. Your feedback will be appreciated. Some of the input we received is as follows:<br \/>\n<strong>\u201cQ: What is an algorithm?<br \/>\n<\/strong><strong>A: <\/strong>An algorithm is a set of well-defined steps that leads from inputs (data) to outputs (results). Today, algorithms are used in decision-making in education, access to credit, employment, and in the criminal justice system. \u00a0An algorithm can be compared to a recipe that runs in the same way each time, automatically using the given input data. The input data is combined and placed through the same set of steps, and the output is dependent on the input data and the set of steps that comprise the algorithm.&#8221;<br \/>\nand<br \/>\n<strong>&#8220;Q: Can algorithms be explained? Why or why not? \u00a0What are the challenges?<br \/>\n<\/strong><strong>A:<\/strong> It is not always possible to interpret machine learning and algorithmic models. This is because a model may use an enormous volume of data in the process of figuring out the ideal approach. This in turn, makes it hard to go back and trace how the algorithm arrived at a certain decision.\u201d<\/p>\n<p>This post raises an issue with the use of the term \u201calgorithm\u201d in the era of Big Data in which the term \u201cmachine learning\u201d has been incorporated into the field of data analytics and data science. The AI community needs, in the case of the ATA issues, to give\u00a0careful attention to definitions and concepts that enables a\u00a0clear discourse on ATA policy.<\/p>\n<p>A case in point, and we welcome input of SIGAI, is the central role of artificial neural networks (NN) in machine learning and deep learning. In what sense is a NN algorithmic? Toward the goal of algorithmic transparency, what needs to be explained about how a NN works? From a policy perspective, what are the challenges in addressing the transparency of a NN component of machine learning frameworks with audiences of varying technical backgrounds?<\/p>\n<p>The mechanisms for training neural networks are algorithmic in the traditional sense of the word by using a series of steps repeatedly in the adjustment of parameters such as in multilayer perceptron learning. The algorithms in NN training methods operate the same way for all specific applications in which input data is mapped to output results. Only a high-level discussion and use of simplified diagrams are practical for \u201cexplaining\u201d these NN algorithms to policymakers and end users of systems involving machine learning.<\/p>\n<p>On the other hand, the design and implementation of applications involving NN-based machine learning are surely the real points of concern for issues of \u201calgorithmic transparency\u201d. In that regard, the \u201cexplanation\u201d of a particular application could discuss the careful description of a problem to be solved and the NN design model chosen to\u00a0solve the problem. Further, (for now) human choices are made about the number and types of input items and the numbers of nodes and layers, method for cleaning and normalizing input data, choice\u00a0of an appropriate error measure and number of training cycles, appropriate procedure for independent testing, and the interpretation of results with realistic uncertainty estimates. The application development procedure is algorithmic in a general sense, but the more important point is that assumptions and biases are involved in the design and implementation of the\u00a0NN. The choice of data, and its relevance and quality, are eminently important in understanding the validity of a system involving machine learning. Thus, the transparency of NN algorithms, in the technical sense, might well be explained, but the transparency and biases of the model and implementation process are the aspects with serious policy consequences.<\/p>\n<p>We welcome your feedback!<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Our July 15th post summarized the\u00a0USACM-EUACM joint statement\u00a0on Algorithmic Transparency and Accountability (ATA) and introduced the ATA FAQ project by the USACM Algorithms Working Group. Their goal is \u201cto take the lead addressing the technical aspects of algorithms and to have content prepared for media inquiries and policymakers.\u201d The SIGAI has been asked to contribute &hellip; <a href=\"https:\/\/sigai.acm.org\/aimatters\/blog\/2017\/08\/02\/algorithms-and-algorithmic-transparency\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Algorithms and Algorithmic Transparency&#8221;<\/span><\/a><\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[4],"tags":[],"_links":{"self":[{"href":"https:\/\/sigai.acm.org\/aimatters\/blog\/wp-json\/wp\/v2\/posts\/181"}],"collection":[{"href":"https:\/\/sigai.acm.org\/aimatters\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/sigai.acm.org\/aimatters\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/sigai.acm.org\/aimatters\/blog\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/sigai.acm.org\/aimatters\/blog\/wp-json\/wp\/v2\/comments?post=181"}],"version-history":[{"count":4,"href":"https:\/\/sigai.acm.org\/aimatters\/blog\/wp-json\/wp\/v2\/posts\/181\/revisions"}],"predecessor-version":[{"id":185,"href":"https:\/\/sigai.acm.org\/aimatters\/blog\/wp-json\/wp\/v2\/posts\/181\/revisions\/185"}],"wp:attachment":[{"href":"https:\/\/sigai.acm.org\/aimatters\/blog\/wp-json\/wp\/v2\/media?parent=181"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/sigai.acm.org\/aimatters\/blog\/wp-json\/wp\/v2\/categories?post=181"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/sigai.acm.org\/aimatters\/blog\/wp-json\/wp\/v2\/tags?post=181"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}