{"id":5542,"date":"2021-05-07T10:36:27","date_gmt":"2021-05-07T08:36:27","guid":{"rendered":"https:\/\/joapen.com\/blog\/?p=5542"},"modified":"2021-05-07T11:05:53","modified_gmt":"2021-05-07T09:05:53","slug":"notes-about-convolutional-neural-networks","status":"publish","type":"post","link":"http:\/\/joapen.com\/blog\/2021\/05\/07\/notes-about-convolutional-neural-networks\/","title":{"rendered":"Notes about convolutional neural networks"},"content":{"rendered":"\n<p>Let&#8217;s start with <a href=\"https:\/\/en.wikipedia.org\/wiki\/Convolutional_neural_network\" target=\"_blank\" rel=\"noreferrer noopener\">Wikipedia<\/a>: In deep learning, a convolutional neural network (CNN, or ConvNet) is a class of deep neural network, most commonly applied to analyze <strong>visual imagery<\/strong>.<\/p>\n\n\n\n<p>The name \u201cconvolutional neural network\u201d indicates that the network employs a mathematical operation called&nbsp;<strong>convolution<\/strong>. The convolutional networks are a specialized type of neural networks that use convolution in place of general matrix multiplication in at least one of their layers.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Representation of the matrix multiplication in one layer:<\/h3>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"aligncenter\"><img decoding=\"async\" src=\"https:\/\/www.freecodecamp.org\/news\/content\/images\/2021\/02\/activation-map.png\" alt=\"matrix multiplication in one layer for a convolution neural network\"\/><figcaption>matrix multiplication in one layer for a convolution neural network<\/figcaption><\/figure><\/div>\n\n\n\n<p>A convolutional neural network processes data that has a grid-like arrangement then extracts important features. One huge advantage of using CNNs is that you don&#8217;t need to do a lot of pre-processing on images.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/www.researchgate.net\/profile\/Jose-Benitez-Andrades\/publication\/339447623\/figure\/fig2\/AS:862056077082627@1582541593714\/A-vanilla-Convolutional-Neural-Network-CNN-representation.png\" alt=\"A vanilla Convolutional Neural Network (CNN) representation.\"\/><figcaption>A vanilla Convolutional Neural Network (CNN) representation<\/figcaption><\/figure>\n\n\n\n<h3 class=\"wp-block-heading\">A basic clasiffication of CNNs is by number of dimensions:<\/h3>\n\n\n\n<ul class=\"wp-block-list\"><li><strong>1 Dimension<\/strong>: the CNN kernel moves in one direction. 1D CNNs are usually used on time-series data.<\/li><li><strong>2 Dimensions<\/strong>: the CNN kernel moves in two directions. You&#8217;ll see these used with image labelling and processing. These are the more common ones.<\/li><li><strong>3 Dimensions<\/strong>: the kernel moves in three directions. These CNNs are used on images as CT scans and MRIs.<\/li><\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">Some links to remind<\/h3>\n\n\n\n<ul class=\"wp-block-list\"><li>Microscope, from OpenAI: <a href=\"https:\/\/microscope.openai.com\/models\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/microscope.openai.com\/models<\/a><\/li><li>DeepDream is a computer vision program created by Google engineer Alexander Mordvintsev that uses a convolutional neural network to find and enhance patterns in images: <a href=\"https:\/\/deepdreamgenerator.com\/\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/deepdreamgenerator.com\/<\/a><\/li><\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Let&#8217;s start with Wikipedia: In deep learning, a convolutional neural network (CNN, or ConvNet) is a class of deep neural network, most commonly applied to analyze visual imagery. The name \u201cconvolutional neural network\u201d indicates that the network employs a mathematical operation called&nbsp;convolution. The convolutional networks are a specialized type of neural networks that use convolution &#8230; <a title=\"Notes about convolutional neural networks\" class=\"read-more\" href=\"http:\/\/joapen.com\/blog\/2021\/05\/07\/notes-about-convolutional-neural-networks\/\" aria-label=\"Read more about Notes about convolutional neural networks\">Read more<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[151],"tags":[],"class_list":["post-5542","post","type-post","status-publish","format-standard","hentry","category-machine-learning"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.5 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Notes about convolutional neural networks -<\/title>\n<meta name=\"description\" content=\"Let&#039;s start with Wikipedia: In deep learning, a convolutional neural network (CNN, or ConvNet) is a class of deep neural network, most commonly applied to - joapen projects\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/joapen.com\/blog\/2021\/05\/07\/notes-about-convolutional-neural-networks\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Notes about convolutional neural networks -\" \/>\n<meta property=\"og:description\" content=\"Let&#039;s start with Wikipedia: In deep learning, a convolutional neural network (CNN, or ConvNet) is a class of deep neural network, most commonly applied to - joapen projects\" \/>\n<meta property=\"og:url\" content=\"https:\/\/joapen.com\/blog\/2021\/05\/07\/notes-about-convolutional-neural-networks\/\" \/>\n<meta property=\"og:site_name\" content=\"joapen projects\" \/>\n<meta property=\"article:published_time\" content=\"2021-05-07T08:36:27+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2021-05-07T09:05:53+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.freecodecamp.org\/news\/content\/images\/2021\/02\/activation-map.png\" \/>\n<meta name=\"author\" content=\"joapen\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"joapen\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/joapen.com\\\/blog\\\/2021\\\/05\\\/07\\\/notes-about-convolutional-neural-networks\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/joapen.com\\\/blog\\\/2021\\\/05\\\/07\\\/notes-about-convolutional-neural-networks\\\/\"},\"author\":{\"name\":\"joapen\",\"@id\":\"https:\\\/\\\/joapen.com\\\/blog\\\/#\\\/schema\\\/person\\\/23919df2312175fe9c4609203595b217\"},\"headline\":\"Notes about convolutional neural networks\",\"datePublished\":\"2021-05-07T08:36:27+00:00\",\"dateModified\":\"2021-05-07T09:05:53+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/joapen.com\\\/blog\\\/2021\\\/05\\\/07\\\/notes-about-convolutional-neural-networks\\\/\"},\"wordCount\":244,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/joapen.com\\\/blog\\\/#\\\/schema\\\/person\\\/23919df2312175fe9c4609203595b217\"},\"image\":{\"@id\":\"https:\\\/\\\/joapen.com\\\/blog\\\/2021\\\/05\\\/07\\\/notes-about-convolutional-neural-networks\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.freecodecamp.org\\\/news\\\/content\\\/images\\\/2021\\\/02\\\/activation-map.png\",\"articleSection\":[\"Machine Learning\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/joapen.com\\\/blog\\\/2021\\\/05\\\/07\\\/notes-about-convolutional-neural-networks\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/joapen.com\\\/blog\\\/2021\\\/05\\\/07\\\/notes-about-convolutional-neural-networks\\\/\",\"url\":\"https:\\\/\\\/joapen.com\\\/blog\\\/2021\\\/05\\\/07\\\/notes-about-convolutional-neural-networks\\\/\",\"name\":\"Notes about convolutional neural networks -\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/joapen.com\\\/blog\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/joapen.com\\\/blog\\\/2021\\\/05\\\/07\\\/notes-about-convolutional-neural-networks\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/joapen.com\\\/blog\\\/2021\\\/05\\\/07\\\/notes-about-convolutional-neural-networks\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.freecodecamp.org\\\/news\\\/content\\\/images\\\/2021\\\/02\\\/activation-map.png\",\"datePublished\":\"2021-05-07T08:36:27+00:00\",\"dateModified\":\"2021-05-07T09:05:53+00:00\",\"description\":\"Let's start with Wikipedia: In deep learning, a convolutional neural network (CNN, or ConvNet) is a class of deep neural network, most commonly applied to - joapen projects\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/joapen.com\\\/blog\\\/2021\\\/05\\\/07\\\/notes-about-convolutional-neural-networks\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/joapen.com\\\/blog\\\/2021\\\/05\\\/07\\\/notes-about-convolutional-neural-networks\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/joapen.com\\\/blog\\\/2021\\\/05\\\/07\\\/notes-about-convolutional-neural-networks\\\/#primaryimage\",\"url\":\"https:\\\/\\\/www.freecodecamp.org\\\/news\\\/content\\\/images\\\/2021\\\/02\\\/activation-map.png\",\"contentUrl\":\"https:\\\/\\\/www.freecodecamp.org\\\/news\\\/content\\\/images\\\/2021\\\/02\\\/activation-map.png\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/joapen.com\\\/blog\\\/2021\\\/05\\\/07\\\/notes-about-convolutional-neural-networks\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/joapen.com\\\/blog\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Notes about convolutional neural networks\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/joapen.com\\\/blog\\\/#website\",\"url\":\"https:\\\/\\\/joapen.com\\\/blog\\\/\",\"name\":\"joapen projects\",\"description\":\"Just a place to write\",\"publisher\":{\"@id\":\"https:\\\/\\\/joapen.com\\\/blog\\\/#\\\/schema\\\/person\\\/23919df2312175fe9c4609203595b217\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/joapen.com\\\/blog\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":[\"Person\",\"Organization\"],\"@id\":\"https:\\\/\\\/joapen.com\\\/blog\\\/#\\\/schema\\\/person\\\/23919df2312175fe9c4609203595b217\",\"name\":\"joapen\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/joapen.com\\\/blog\\\/wp-content\\\/uploads\\\/2021\\\/04\\\/joapen-mini.jpeg\",\"url\":\"https:\\\/\\\/joapen.com\\\/blog\\\/wp-content\\\/uploads\\\/2021\\\/04\\\/joapen-mini.jpeg\",\"contentUrl\":\"https:\\\/\\\/joapen.com\\\/blog\\\/wp-content\\\/uploads\\\/2021\\\/04\\\/joapen-mini.jpeg\",\"width\":400,\"height\":400,\"caption\":\"joapen\"},\"logo\":{\"@id\":\"https:\\\/\\\/joapen.com\\\/blog\\\/wp-content\\\/uploads\\\/2021\\\/04\\\/joapen-mini.jpeg\"},\"sameAs\":[\"http:\\\/\\\/www.joapen.com\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Notes about convolutional neural networks -","description":"Let's start with Wikipedia: In deep learning, a convolutional neural network (CNN, or ConvNet) is a class of deep neural network, most commonly applied to - joapen projects","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/joapen.com\/blog\/2021\/05\/07\/notes-about-convolutional-neural-networks\/","og_locale":"en_US","og_type":"article","og_title":"Notes about convolutional neural networks -","og_description":"Let's start with Wikipedia: In deep learning, a convolutional neural network (CNN, or ConvNet) is a class of deep neural network, most commonly applied to - joapen projects","og_url":"https:\/\/joapen.com\/blog\/2021\/05\/07\/notes-about-convolutional-neural-networks\/","og_site_name":"joapen projects","article_published_time":"2021-05-07T08:36:27+00:00","article_modified_time":"2021-05-07T09:05:53+00:00","og_image":[{"url":"https:\/\/www.freecodecamp.org\/news\/content\/images\/2021\/02\/activation-map.png","type":"","width":"","height":""}],"author":"joapen","twitter_misc":{"Written by":"joapen","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/joapen.com\/blog\/2021\/05\/07\/notes-about-convolutional-neural-networks\/#article","isPartOf":{"@id":"https:\/\/joapen.com\/blog\/2021\/05\/07\/notes-about-convolutional-neural-networks\/"},"author":{"name":"joapen","@id":"https:\/\/joapen.com\/blog\/#\/schema\/person\/23919df2312175fe9c4609203595b217"},"headline":"Notes about convolutional neural networks","datePublished":"2021-05-07T08:36:27+00:00","dateModified":"2021-05-07T09:05:53+00:00","mainEntityOfPage":{"@id":"https:\/\/joapen.com\/blog\/2021\/05\/07\/notes-about-convolutional-neural-networks\/"},"wordCount":244,"commentCount":0,"publisher":{"@id":"https:\/\/joapen.com\/blog\/#\/schema\/person\/23919df2312175fe9c4609203595b217"},"image":{"@id":"https:\/\/joapen.com\/blog\/2021\/05\/07\/notes-about-convolutional-neural-networks\/#primaryimage"},"thumbnailUrl":"https:\/\/www.freecodecamp.org\/news\/content\/images\/2021\/02\/activation-map.png","articleSection":["Machine Learning"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/joapen.com\/blog\/2021\/05\/07\/notes-about-convolutional-neural-networks\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/joapen.com\/blog\/2021\/05\/07\/notes-about-convolutional-neural-networks\/","url":"https:\/\/joapen.com\/blog\/2021\/05\/07\/notes-about-convolutional-neural-networks\/","name":"Notes about convolutional neural networks -","isPartOf":{"@id":"https:\/\/joapen.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/joapen.com\/blog\/2021\/05\/07\/notes-about-convolutional-neural-networks\/#primaryimage"},"image":{"@id":"https:\/\/joapen.com\/blog\/2021\/05\/07\/notes-about-convolutional-neural-networks\/#primaryimage"},"thumbnailUrl":"https:\/\/www.freecodecamp.org\/news\/content\/images\/2021\/02\/activation-map.png","datePublished":"2021-05-07T08:36:27+00:00","dateModified":"2021-05-07T09:05:53+00:00","description":"Let's start with Wikipedia: In deep learning, a convolutional neural network (CNN, or ConvNet) is a class of deep neural network, most commonly applied to - joapen projects","breadcrumb":{"@id":"https:\/\/joapen.com\/blog\/2021\/05\/07\/notes-about-convolutional-neural-networks\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/joapen.com\/blog\/2021\/05\/07\/notes-about-convolutional-neural-networks\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/joapen.com\/blog\/2021\/05\/07\/notes-about-convolutional-neural-networks\/#primaryimage","url":"https:\/\/www.freecodecamp.org\/news\/content\/images\/2021\/02\/activation-map.png","contentUrl":"https:\/\/www.freecodecamp.org\/news\/content\/images\/2021\/02\/activation-map.png"},{"@type":"BreadcrumbList","@id":"https:\/\/joapen.com\/blog\/2021\/05\/07\/notes-about-convolutional-neural-networks\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/joapen.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Notes about convolutional neural networks"}]},{"@type":"WebSite","@id":"https:\/\/joapen.com\/blog\/#website","url":"https:\/\/joapen.com\/blog\/","name":"joapen projects","description":"Just a place to write","publisher":{"@id":"https:\/\/joapen.com\/blog\/#\/schema\/person\/23919df2312175fe9c4609203595b217"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/joapen.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":["Person","Organization"],"@id":"https:\/\/joapen.com\/blog\/#\/schema\/person\/23919df2312175fe9c4609203595b217","name":"joapen","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/joapen.com\/blog\/wp-content\/uploads\/2021\/04\/joapen-mini.jpeg","url":"https:\/\/joapen.com\/blog\/wp-content\/uploads\/2021\/04\/joapen-mini.jpeg","contentUrl":"https:\/\/joapen.com\/blog\/wp-content\/uploads\/2021\/04\/joapen-mini.jpeg","width":400,"height":400,"caption":"joapen"},"logo":{"@id":"https:\/\/joapen.com\/blog\/wp-content\/uploads\/2021\/04\/joapen-mini.jpeg"},"sameAs":["http:\/\/www.joapen.com"]}]}},"_links":{"self":[{"href":"http:\/\/joapen.com\/blog\/wp-json\/wp\/v2\/posts\/5542","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/joapen.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/joapen.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/joapen.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/joapen.com\/blog\/wp-json\/wp\/v2\/comments?post=5542"}],"version-history":[{"count":2,"href":"http:\/\/joapen.com\/blog\/wp-json\/wp\/v2\/posts\/5542\/revisions"}],"predecessor-version":[{"id":5545,"href":"http:\/\/joapen.com\/blog\/wp-json\/wp\/v2\/posts\/5542\/revisions\/5545"}],"wp:attachment":[{"href":"http:\/\/joapen.com\/blog\/wp-json\/wp\/v2\/media?parent=5542"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/joapen.com\/blog\/wp-json\/wp\/v2\/categories?post=5542"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/joapen.com\/blog\/wp-json\/wp\/v2\/tags?post=5542"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}