“The team has created a first-of-its-kind algorithm that can interpret and accurately reproduce images seen or imagined by a person,” wrote Alexandru Micu in ZME Science.
Their paper, “Deep image reconstruction from human brain activity,” is on bioRxiv. The authors are Guohua Shen, Tomoyasu Horikawa, Kei Majima, and Yukiyasu Kamitani.
Vanessa Ramirez, associate editor of Singularity Hub, was one of several writers on tech watching sites who reported on the study. The writers noted that this would mark a difference from other research involved in deconstructing images based on pixels and basic shapes.
“Trying to tame a computer to decode mental images isn’t a new idea,” said Micu. “However, all previous systems have been limited in scope and ability. Some can only handle narrow domains like facial shape, while others can only rebuild images from preprogrammed images or categories.”
What is special here, Micu said, is that “their new algorithm can generate new, recognizable images from scratch.”
The study team has been exploring deep image reconstruction. Micu quoted the senior author of the study. “We believe that a deep neural network is good proxy for the brain’s hierarchical processing,” said Yukiyasu Kamitani.
Overview of deep image reconstruction is shown. The pixels’ values of the input image are optimized so that the DNN features of the image are similar to those decoded from fMRI activity. A deep generator network (DGN) is optionally combined with the DNN to produce natural-looking images, in which optimization is performed at the input space of the DGN. Credit: bioRxiv (2017). DOI: 10.1101/240317
Machine learning-based analysis of human functional magnetic resonance imaging (fMRI) patterns has enabled the visualization of perceptual content. However, it has been limited to the reconstruction with low-level image bases (Miyawaki et al., 2008; Wen et al., 2016) or to the matching to exemplars (Naselaris et al., 2009; Nishimoto et al., 2011). Recent work showed that visual cortical activity can be decoded (translated) into hierarchical features of a deep neural network (DNN) for the same input image, providing a way to make use of the information from hierarchical visual features (Horikawa & Kamitani, 2017). Here, we present a novel image reconstruction method, in which the pixel values of an image are optimized to make its DNN features similar to those decoded from human brain activity at multiple layers. We found that the generated images resembled the stimulus images (both natural images and artificial shapes) and the subjective visual content during imagery. While our model was solely trained with natural images, our method successfully generalized the reconstruction to artificial shapes, indicating that our model indeed reconstructs or generates images from brain activity, not simply matches to exemplars. A natural image prior introduced by another deep neural network effectively rendered semantically meaningful details to reconstructions by constraining reconstructed images to be similar to natural images. Furthermore, human judgment of reconstructions suggests the effectiveness of combining multiple DNN layers to enhance visual quality of generated images. The results suggest that hierarchical visual information in the brain can be effectively combined to reconstruct perceptual and subjective images.
Episteme Spacecraft Project & Molecular Historicism
In 2010 I wrote a satire piece about the determinisms of religion and science entitled “How to make a spacecraft” where I proposed the fundamentals of the Episteme Spacecraft Project and the three tests.
The idea is that we could take the life specific data of a living organism and correlate it with its DNA and form a database with as many species as possible and in turn when looking at a new organism (even an alien organism) we could program that database to produce a DNA from other life specific data. The connection point of data from data is symbiosis and the aim is to employ the DNA as a symbiosis based operating system that has ability to convert different types of life specific data to each other.
In this e-book you will also find my philosophical reasoning that I call Molecular Historicism as a basis for and as a result of the Episteme Spacecraft project. Molecular Historicism refers to DNA as the primary element because DNA refers to molecule as future action, as life. I think that every living thing has an individual reality of time and life could be considered the potential of every atom. As such we could talk about a unified field & time of life in the universe pulsing to a universal symbiosis.
Table of Contents
Episteme Spacecraft Project
1) What am I doing here, the undertaking;
Visions of the Future from Biological Sciences
2) An Introductive Summary
Correspondence with the Editor of Journal of Cosmology
3) The First Test; The Biological Pi
Research Related to Approach and Logic of Relation
DNA to Image
An Example of Correlation of Image to Sound
The use of DNA for Purposes other than interaction within the cell
DNA imaged with electron microscope for the first time
4) The Second Test; DNA of Earth
Life Possible Frequency Isolation; DNA of Earth
Research Related to Approach and Logic of Relation
NASA Earth Science Data
Using satellite images to detect cellular organisms
Using satellite images to detect bark beetle outbreaks in forests
Spectral band discrimination for species observed from hyperspectral remote sensing
Example of Reverse Engineering Project Working With Biological Data
5) The Third Test; Standard Deviation for Planets
Standard Deviation for a Specific Planet or Moon
The Biological Pi; Perfecting the DNA of Earth
Symbiosis; The Premise of the Episteme Spacecraft Thesis
6) Blueprint for a Consortium
7) Forum Entries
The Foundations of the Idea of Molecular Historicism
What is life?
What is nature?
What is the body and particularly the human body?
The Critical Applications of the Idea of Molecular Historicism
Prof. Stephen Hawking and the question of the brain as a machine
Thinking together with life; Justice for the Scope of Life
The Question of Entropy; what is Entropy to Life?
The boundaries of the body and the reaches of the atomic body
Genetically Modified Organisms (GMO’s)
Naturality of Nature
The Nature Shaped by Humans
The Particle Collusion Experiments at LHC at CERN
Naturality of Nature
The Nature Shaped by Humans
A new fate; so where is free will?
The Biological Efficiency & Value of Evolution & Reasons for Biomimicry
A Hum in a Roaring World
“Falling to a Tea House Garden” is a selection of my poetry in Turkish and English that I have been writing for the last 24 years and it consists of three parts. The first part “Couples/Çiftetelli” are Turkish
and English poems that I associated together due to meaning, period or form. I originally wrote the first poem in this first part in English and then translated it to Turkish. Apart from this one poem, none of the poems have been translated into the other language. Among my muses are cinema, music, song lyrics, novels, the history of science, arts and religion, aphorisms, idioms, proverbs, caricatures, and folklore. In my poems, I dwell on the topics of nature, philosophy, human and the tragic situation. Here, there are things that I do not want to repeat in life and heeds to myself as well as the truths I have found walking the roads that I did and the experiences I gained. When I write I leave little information with regards to date and time but the second and third parts of the book, “Turkish Poems” and “English Poems” are more or less in a chronological order.
A poet, a researcher and a self-trained painter born in 1978. Graduated from University of Kent at Canterbury in the UK, from the Department of Politics and International Relations in 1999. Went onto study art and art history in Florence, Italy. Attended Philosophy and Cultural Analysis M.A. program at the University of Amsterdam.
Been writing poetry since 15 years old. In his 20’s he collaborated with philosophy, logic and anthropology students from the University of Amsterdam to publish an online magazine and a zine, where his poetry, drawings, and collages took part. In his 30’s he took to the stage reading his poetry in Spoken Word İstanbul and the poetry events of different literature groups in Çanakkale. Çanakkale Olay Newspaper also printed his poems in the newspaper’s art pages. Been painting since 2000. In 2005 exhibited for the first time at a mixed exhibition at Siemens Art Gallery in İstanbul. First personal painting exhibition was held in the Turkish Culture Ministry Gallery, in Çanakkale in 2016.
“Çay Bahçesine Düşerken” benim 24 yıldır yazdığım Türkçe ve İngilizce şiirlerden bir seçkidir ve üç bölümden oluşmaktadır. “Couples/Çiftetelli” anlam, dönem ya da düzen olarak birbirine yakıştırdığım Türkçe ve İngilizce şiirlerden eşli bir seçkidir. Bu ilk bölümdeki ilk şiir İngilizce yazılmış ve tarafımdan Türkçeye çevrilmiştir. Kitapta bu şiir dışında hiçbir şiir diğer dile çeviri değildir. Sinema, müzik, şarkı sözleri, romanlar, bilim, sanat ve din tarihi, özdeyişler, deyimler, atasözleri, karikatürler ve folklordan ilham alıyorum ve şiirlerde doğa, felsefe, insan ve trajik durum gibi konular işliyorum. Yürüdüğüm yollar ve edindiğim deneyimlerle bulduğum gerçekler kadar, yaşamda tekrar etmek istemediklerim ve kendime uyarılar da var burada. Nadiren tarih attığımdan şiirlerimde dönem bilgisine az rastlanır, ancak kitabın ikinci ve üçüncü bölümleri olan “Türkçe Şiirler” ve “İngilizce Şiirler” aşağı yukarı kronolojik bir sıra izlenilerek dizilmiştir.
1978 doğumlu bir şair, araştırmacı ve alaylı bir ressam. Eğitim için gittiği İngiltere’de University of Kent at Canterbury’den Siyasal Bilimler ve Uluslararası İlişkiler bölümünden 1999 yılında mezun oldu. İtalya, Floransa’da sanat ve sanat tarihi eğitimleri aldı. Hollanda’da Amsterdam Üniversitesi’nde Felsefe ve Kültürel Analiz yüksek lisans programına katıldı.
15 yaşından beri şiir yazıyor. 20’lerinde Amsterdam Üniversitesi’nden bir grup felsefe, mantık ve antropoloji
öğrencisi ile çıkarttıkları internet dergisinde ve fanzinde şiirleri, çizimleri ve kolajları yer aldı. 30’larında İstanbul’da
Spoken Word gecelerinde ve Çanakkale’de çeşitli edebiyat etkinliklerinde sahne aldı ve şiiirlerini okudu. Ayrıca şiirleri Çanakkale Olay Gazetesi’nde sanat sayfasında yayınlandı.
2000’lerden beri resim yapıyor. 2005’de İstanbul’da, Siemens Sanat Galerisi’nde ilk karma sergisine katıldı. İlk kişisel resim sergisini 2016’da Çanakkale’de Devlet Güzel Sanatlar Galerisi’nde açtı.
Book Purchase Link:
This is my facebook page containing hundreds of links to modern and current scientific research. Please like and follow the page!
The brain has a weak electrical force around it that transmits information;
“Researchers in the US have recorded neural spikes travelling too slowly in the brain to be explained by conventional signalling mechanisms. In the absence of other plausible explanations, the scientists believe these brain waves are being transmitted by a weak electrical field, and they’ve been able to detect one of these in mice.
“Researchers have thought that the brain’s endogenous electrical fields are too weak to propagate wave transmission,” said Dominique Durand, a biomedical engineer at Case Western Reserve University. “But it appears the brain may be using the fields to communicate without synaptic transmissions, gap junctions or diffusion.”
Running computer simulations to model their hypothesis, the researchers found that electrical fields can mediate propagation across layers of neurons. While the field is of low amplitude (approximately 2–6 mV/mm), it’s able to excite and activate immediate neighbours, which subsequently activate more neurons, travelling across the brain at about 10 centimetres per second.
Welcome to my world 😉 Science can not even pin point "thinking" to the brain. I wrote this article in 2012;http://cosmosclan.blogspot.com.tr/2012/08/life-span-and-entropy.html
Welcome to my world Science can not even pin point “thinking” to the brain. I wrote this article in 2012;
(It is also available among my writings here; http://www.alphan.net/writings/ )
#derlerki Masalcılar Buluşması, Mardin Müzesi sergisi için 2 iş.
Derler ki, can ile başlayan benzerlik, simbiyoz halkaları ile bağlanırmış her bir sistemdeki kamp ateşine, ve güneşin soğurduğu ışık altında bizler ne isek, başka bir yıldızın ateşine ısınan başkaları da kamp ateşinden kamp ateşine bir şarkı bir masal kadar uzakmış…
(Pleksi üzerine Güneş spektrumu ve DNA fotoğrafları baskı, 4numara elek üzerine yerleşim ve içe şerit led döşeme)
Derler ki, azınlıktan anneannelerinin ellerini öpmeyen diller, etmedikleri hürmet için kravat takıp imzaladıkları ile kirlenirmiş, bir güzelleme, bir şifayı bildiğinden seç denilince, bir amerikan naylon gecelik üstüne ilmik ilmik, sabrın batıya el pençe divan duran kelimeleri işlenirmiş, olduğu gibi “aziz aşk”, “as is love”…
(Kasnak, kumaş, iplik, iğne)
“L’viv I Love You”, Acrylic on Cloth Wrapped Carton, 2017