{"product_id":"information-theory-for-data-science-9781638281146","title":"Information Theory for Data Science","description":"\u003cb\u003eBook Synopsis\u003c\/b\u003e\u003cbr\u003eInformation theory deals with mathematical laws that govern the flow, representation and transmission of information. The most significant achievement of the field is the invention of digital communication which forms the basis of our daily-life digital products such as smart phones, laptops and any IoT devices. Recently it has also found important roles in a spotlight field that has been revolutionized during the past decades: data science.\u003cbr\u003e\u003cbr\u003eThis book aims at demonstrating modern roles of information theory in a widening array of data science applications. The first and second parts of the book covers the core concepts of information theory: basic concepts on several key notions; and celebrated source and channel coding theorems which concern the fundamental limits of communication. The last part focuses on applications that arise in data science, including social networks, ranking, and machine learning.\u003cbr\u003e\u003cbr\u003eThe book is written as a text for senior undergraduate and graduate students working on Information Theory and Communications, and it should also prove to be a valuable reference for professionals and engineers from these fields.\u003cbr\u003e\u003cbr\u003e\u003cb\u003eTable of Contents\u003c\/b\u003e\u003cbr\u003e\u003cul\u003e\n\u003cli\u003e1 Source Coding\u003c\/li\u003e\n\u003cli\u003e1.1 Overview of the book\u003c\/li\u003e\n\u003cli\u003e1.2 Entropy and Python exercise\u003c\/li\u003e\n\u003cli\u003e1.3 Mutual information, Kullback-Leibler (KL) divergence and Python exercise Problem Set 1\u003c\/li\u003e\n\u003cli\u003e1.4 Source coding theorem for i.i.d. sources (1\/3)\u003c\/li\u003e\n\u003cli\u003e1.5 Source coding theorem for i.i.d. sources (2\/3)\u003c\/li\u003e\n\u003cli\u003e1.6 Source coding theorem for i.i.d. sources (3\/3)Problem Set 2\u003c\/li\u003e\n\u003cli\u003e1.7 Source code design\u003c\/li\u003e\n\u003cli\u003e1.8 Source coding theorem for general sources\u003c\/li\u003e\n\u003cli\u003e1.9 Huffman code and Python implementation\u003c\/li\u003e\n\u003cli\u003eProblem Set 3\u003c\/li\u003e\n\u003cli\u003e2 Channel Coding\u003c\/li\u003e\n\u003cli\u003e2.1 Statement of channel coding theorem\u003c\/li\u003e\n\u003cli\u003e2.2 Achievability proof for the binary erasure channel\u003c\/li\u003e\n\u003cli\u003e2.3 Achievability proof for the binary symmetric channelProblem Set 4\u003c\/li\u003e\n\u003cli\u003e2.4 Achievability proof for discrete memoryless channels\u003c\/li\u003e\n\u003cli\u003e2.5 Converse proof for discrete memoryless channels\u003c\/li\u003e\n\u003cli\u003e2.6 Source-channel separation theorem and feedback\u003c\/li\u003e\n\u003cli\u003eProblem Set 5\u003c\/li\u003e\n\u003cli\u003e2.7 Polar code: Polarization\u003c\/li\u003e\n\u003cli\u003e2.8 Polar code: Implementation of polarization\u003c\/li\u003e\n\u003cli\u003e2.9 Polar code: Proof of polarization and Python simulation\u003c\/li\u003e\n\u003cli\u003eProblem Set 6\u003c\/li\u003e\n\u003cli\u003e3 Data Science Applications\u003c\/li\u003e\n\u003cli\u003e3.1 Social networks: Fundamental limits\u003c\/li\u003e\n\u003cli\u003e3.2 Social networks: Achievability proof\u003c\/li\u003e\n\u003cli\u003e3.3 Social networks: Converse proof\u003c\/li\u003e\n\u003cli\u003e3.4 Social networks: Algorithm and Python implementationProblem Set 7\u003c\/li\u003e\n\u003cli\u003e3.5 DNA sequencing: Fundamental limits\u003c\/li\u003e\n\u003cli\u003e3.6 DNA sequencing: Achievability proof\u003c\/li\u003e\n\u003cli\u003e3.7 DNA sequencing: Converse proof \u003c\/li\u003e\n\u003cli\u003e3.8 DNA sequencing: Algorithm and Python implementationProblem Set 8\u003c\/li\u003e\n\u003cli\u003e3.9 Top-K ranking: Fundamental limits\u003c\/li\u003e\n\u003cli\u003e3.10 Top-K ranking: Algorithm\u003c\/li\u003e\n\u003cli\u003e3.11 Top-K ranking: Python implementation\u003c\/li\u003e\n\u003cli\u003eProblem Set 9\u003c\/li\u003e\n\u003cli\u003e3.12 Supervised learning: Connection with information theory\u003c\/li\u003e\n\u003cli\u003e3.13 Supervised learning: Logistic regression and cross entropy\u003c\/li\u003e\n\u003cli\u003e3.14 Supervised learning: TensorFlow implementation\u003c\/li\u003e\n\u003cli\u003eProblem Set 10\u003c\/li\u003e\n\u003cli\u003e3.15 Unsupervised learning: Generative modeling\u003c\/li\u003e\n\u003cli\u003e3.16 Generative Adversarial Networks (GANs) and KL divergence\u003c\/li\u003e\n\u003cli\u003e3.17 GANs: TensorFlow implementation\u003c\/li\u003e\n\u003cli\u003eProblem Set 11\u003c\/li\u003e\n\u003cli\u003e3.18 Fair machine learning and mutual information (1\/2)\u003c\/li\u003e\n\u003cli\u003e3.19 Fair machine learning and mutual information (2\/2)\u003c\/li\u003e\n\u003cli\u003e3.20 Fair machine learning: TensorFlow implementation\u003c\/li\u003e\n\u003cli\u003eProblem Set 12\u003c\/li\u003e\n\u003cli\u003eAppendices\u003c\/li\u003e\n\u003cli\u003eA – Python Basics\u003c\/li\u003e\n\u003cli\u003eB – TensorFlow and Keras Basics\u003c\/li\u003e\n\u003cli\u003eC – Note on Research\u003c\/li\u003e\n\u003cli\u003e\u003cul\u003e\u003c\/ul\u003e\u003c\/li\u003e\n\u003c\/ul\u003e","brand":"now publishers Inc","offers":[{"title":"Default Title","offer_id":52151329784151,"sku":"9781638281146","price":109.25,"currency_code":"GBP","in_stock":true}],"thumbnail_url":"\/\/cdn.shopify.com\/s\/files\/1\/0817\/1739\/5799\/files\/9781638281146.jpg?v=1762960851","url":"https:\/\/bookcurl.com\/products\/information-theory-for-data-science-9781638281146","provider":"Book Curl","version":"1.0","type":"link"}