- 1
- 639 536
Layerwise Lectures
Приєднався 15 сер 2022
Reality comes in layers - layers of abstraction. This channels tries to uncover them to gain insights on neuroscience and machine learning.
How are memories stored in neural networks? | The Hopfield Network #SoME2
Can we measure memories in networks of neurons in bytes? Or should we think of our memory differently?
Submission to the Summer of Math Exposition 2022 (#SoME2). More information: summerofmathexposition.substack.com/p/the-summer-of-math-exposition-is
Time stamps:
0:00 - Where is your memory?
1:41 - Computer memory in a nutshell
2:58 - Modeling neural networks
4:42 - Memories in dynamical systems
9:54 - Learning
13:36 - Memory capacity and conclusion
Animations largely made using the manim community edition:
www.manim.community/
Original Paper on Hopfield Networks:
Hopfield, J. J. (1982). Neural networks and physical systems with emergent collective computational abilities. Proceedings of the national academy of sciences, 79(8), 2554-2558.
Neuron image by Santiago Ramón y Cajal, The pyramidal neuron of the cerebral cortex, 1904 Ink and pencil on paper, 8 5/8 x 6 7/8 in. Credit: Cajal Institute (CSIC), Madrid
Music: Aakash Gandhi - "Dreamland"
Submission to the Summer of Math Exposition 2022 (#SoME2). More information: summerofmathexposition.substack.com/p/the-summer-of-math-exposition-is
Time stamps:
0:00 - Where is your memory?
1:41 - Computer memory in a nutshell
2:58 - Modeling neural networks
4:42 - Memories in dynamical systems
9:54 - Learning
13:36 - Memory capacity and conclusion
Animations largely made using the manim community edition:
www.manim.community/
Original Paper on Hopfield Networks:
Hopfield, J. J. (1982). Neural networks and physical systems with emergent collective computational abilities. Proceedings of the national academy of sciences, 79(8), 2554-2558.
Neuron image by Santiago Ramón y Cajal, The pyramidal neuron of the cerebral cortex, 1904 Ink and pencil on paper, 8 5/8 x 6 7/8 in. Credit: Cajal Institute (CSIC), Madrid
Music: Aakash Gandhi - "Dreamland"
Переглядів: 639 999
I think we kind of store it somehow with help of the eye procesor that read and writes it and even creates its own like hallucination at wil and dreams at will... but the western society is further they can send memory and change what you have made in your mind or changed it... but when they attack you with it during sleep and awake they leave behind huge headache, and they do this to me everyday, thats why I dont sleep more than 5 hours subsequently as the headache of that 5 hour is enough so I just wake up take sigaret with cold water and then sleep again.. the reason is if your eye is closed the method they use traps your eye beams and then it creates more headache then when having eyes open as the beams they use dont reflect back to your eyes and brains pumps up even more and you get their memories/videos even more, that also you can change it and if it is too good they just wake me up or try to make it ugly dream I dont like and i wake up, I win sometimes from them but sometimes they make everything black with a beam to my head so wake up turn around in bed and then go to sleep again... little pricks using me as test human let alone giving me headache reading my mind or implanting it, again these ghosts are little hiding pricks that have full go of probably secret services in nato and other northern countries... as sunni muslims are too good to do this to people and africans/latin are way behind on this technology
bro made a channel dedicated to neural networks, posted one video, gained 24k subs, decided this was enough and left
bro just dropped one video and vanished. Bro is the Gotye of youtube tutorials
4:55
5:50
6:21
6:29
6:40
Captions on, sentence, next timestamp
سبحان الله الذي خلقنا
The merging of memories is imagination? Ingenuity? Creativity? Evolution? 🤔
A hard drive is not memory, it is storage. Different.
Please make a follow up video on how its used in real life Mr Layerwise
you`ve gotta make another video, i felt sad seeing this was your only video yet, the way it was goood
I want to give a million thumb-ups, thanks!
so thought provoking ! thank u
Please bring more videos
Dude simulated forgetting something and called it an edge case
Yes because like in the networks, memories are stored as the pathways between or as the weights or nodes and the normally “fine tuning” of them to pass through a certain way and the relations between different pathways.
This guy actually died
0:58 this was such an amazing way to phrase how human memory works...we autocomplete them of course. Questions are just an autocompletion request with a filter constraining the memory recalled to more specific details.
**explains human memory assuming a simplified model with all the mathematics laid out** **leaves**
Dude, this is the best video on the topic I've found (and I've looked). When can we expect a follow-up? Would love to watch it.
Saint Hopfield
This was a fantastic explanation. Waiting for more from you!!
Where are you brother
You should upload more , you have potential.
1 video only? Where are you since?
ah now i think i will have a headache for some few days, but thank to you i think i understand it somehow .
LOL, he said that computers were complicated with a ton of technical information, but that neurons were simple. If you’re gonna call computers complicated, you might as well teach a four year college course on neurons.
No offense, by the way
RAM works kind of simply. There are units that store one word (8-bits for 8 bit computer, 32-bits for 32 bit computer, etc), typically a transistor capacitor pair, but could also be assemblies of data storing circuits (DRAM or dynamic RAM and SRAM or static RAM respectively), those units have a selector pin, so if it is on, they will be selected, and if off, they won’t interfere with results, and there is something called a multiplexer of mux that uses some AND and NOT gates to select where the select bit goes. For an address of 0010 (2), you would hook up the first two bits to a NOT gate and then the AND gate, the next bit would be wired directly, and the last bit would go into a NOT and then an AND. In a real chip I believe they may be constructed with several multiplexing layers. After data is stored, it is retrieved by selecting the memory address again. The results of the data have to be ORed together to leave only the active memory address, since everything else is off.
Neurons on the other hand, are complicated mechanisms. Naturally you have the complicated system of the cell. In addition to the cell, you have thousands of inputs. Those inputs can be activated when a small charge is given. If enough inputs are on, the whole body of the neuron becomes positively charged, and it turns its singular input on. Throughout the process, a complicated system of valves and chemicals sends information through synapses and allow the cell to turn on. In addition, the brain’s neurons are arranged in an incredibly efficient manner, but this sacrifices understandability. Hence, we only know one or two neural circuits, because only one or two have an obvious purpose, like timekeeping. It’s like having a computer do Boolean algebra and stuff to create the most efficient way to create a specific circuit, like a 7 segment display decoder. It is efficient, but it is not understandable at all.
Also, memories are stored by reinforcing the connections on neurons with a special substance that insulates the neurons and make them transmit information clearer and faster. However, this substance cannot be removed, so the memories are read only.
Imagine the day humans will be able to load complete memories and knowledge and experience right into the brain. Humanity would take a whole evolutionary turn.
14:00 beautiful.. :)
@ 3:28 I'm afraid that "Modeling" is the act of the ignorant.
The content you provide is greatly appreciated. We are looking forward to your new contents. ❤
please make more videos like this, eagerly waiting
That's why integrated thinking is very easy to remember
Life ~ Memory ~ Life = Neutral Thinking = QM 010
Bro posted absolute gold and dropped off the platform
Why do I keep hearing "kaise hua" music in the background?
Please upload more videos like this. You have yourself a new subscriber sir 🙏
good video.. What tool you use for animations, presentation , voice
I love the animation and presentation style. Keep it up!
this video is great but please change the background to black, my eyes are dying
What it is doing is converging to a familiar state. It seems unessesarily heavy to be actually used in the brain as a way of memorizing information. Its like a person who is trying to fit in by watching what others are doing. Reminds me also of the homunculus, you already need memory to recognize. It feels like a specific techincal method rather than a general way to think about memory, where recognition and expression is done on the same domain.
The unusual thing that human brains perform is a the abstraction of patterns into meta-patterns. yes we store memory holographically but we abstract memories into less specific memories to allow more general application of those memories.We abstract the face of people to allow faster identification but it also results in false positives which when detected our mind switches to more specific memories to resolve the false positive. We store muscle memories in this way allowing us to use the specificity of geometric memory of arm position during an activity but it is abstracted to be used a variety of movement memories. It is this abstraction and resolution reduction of our memories that allow fast application of those memories to the real world. We don't need to know in the first 3 seconds if that tiger approaching us is one we have seen before just that it is a meta-tiger.
would you continue ?
We have NO idea how memories are stored, or, for that matter, what memories are (despite experimental inquiry dating from 1885). A memory is an experience. One does not have unconscious memories. Unconscious content can influence thought and behavior, but content is not coextensive with memory. A memory is the experience of previously non-conscious content (a necessary, but not sufficient condition). It would be refreshing to think psychology and neuroscience had a clue about what they blabber about. Too bad no relief is in sight.
bro never returned 😭
very cool video, easy to understand, and inspiring
Easier to transpose information
human have more patterns on first layer ,and no v and w i think
Neither
It's dead Jim.
I want this follow up video!
I don t believe in memory I had always to demonstrate all memories because of lake of it haha