unsupervised inference with neural networks is getting better?

Fd80f81596aa1cf809ceb1c2077e190b
0
rouncer 103 Feb 20, 2014 at 18:38

Discuss link: unsupervised inference with neural networks is getting better? (www.youtube.com)

this is wierd, am i understanding this wrong?

you just have to upgrade the synapses to respond to matches with euclidean distance?

thats a simple idea, and gets you to more stable object detection, unsupervised?

its still not a huge gain, because euclidean distance is so slow to compute, and if a synapse had to do it when it trained, and everytime it activated (well it trains when it activates) your going to be waiting a long time, well, its way off realtime thats all. its terrible memory wise too cause its as if the synapse touches on an all all connect dendrite for every touch…

if this was the case, then it must have been known already way back in the 50’s, because its such a simple idea just we still dont have the computation power and custom hardware would have too intricate connections to be feesable at all.

well, how hard is it to make a mechanical brain, well, its harder than a computer, not really cell wise, just the dendrites and synapses are impossibly designed.

3 Replies

Please log in or register to post a reply.

Fd80f81596aa1cf809ceb1c2077e190b
0
rouncer 103 Feb 22, 2014 at 05:38

whoops i got it wrong :) theres no distance relationship past the first level. but the strange thing, is he does it on the last level? to what gain?? associate pixels are now not related at all, unless they are?

otherwise why did he do it? :D

the mystery is what makes programming so thrilling!

B5262118b588a5a420230bfbef4a2cdf
1
Stainless 151 Feb 22, 2014 at 12:01

I didn’t get to the end. When I realised he had limited his work to 32 by 32 pixels images, I lost interest.

He does talk about “activity in the final layer”, maybe that’s the key.

Fd80f81596aa1cf809ceb1c2077e190b
0
rouncer 103 Feb 23, 2014 at 00:09

it could be higher res with a linear growth, but probably steep.