Skip to main content

Understanding Neocortex to Create Intelligence

There are two approaches to create intelligence in machines. One is to understand how human brain creates intelligence and replicate the methods used by it to create AI. The other is to take a fresh engineering approach to create intelligence.

There is an ongoing debate as to which approach is feasible or better. Few companies like Numenta and Vicarious have invested in understanding the neocortex. They have launched successful applications that work on the principles of neocortex. Other big companies including Google, Microsoft and Facebook use deep learning to create applications that can do major classification tasks. But deep learning does not exploit the concepts of neocortex, and hence is not up to the mark to do continuous learning. The deep learning models first go through a training phase and then the models are used to do classification.

The idea that makes neocortex truly intelligent is that it is able to do pattern matching and prediction. This has given humans the ability to survive and dominate the animal kingdom. Neocortex, a thin layer formed on top of the brain, started gaining prominence in mammals. A rat with a small sheet of neocortex is able to travel in a maze. It uses the trained patterns to predict the route in a maze. Researchers like Jeff Hawkins, founder of Numenta, believes that this ability of neocortex if replicated in machines will make them truly intelligent. He has created an architecture that exploits the hierarchy of neocortex. He calls it Hierarchical Temporal Memory (HTM). HTM is able to perform online learning like humans, where it doesn't need to use stored models, but the models get updated continuously.

Other approaches that model the neocortex have come into prominence and have received funding. The Blue Brain Project conducted by IBM has received a funding of $4.9 million. The idea is to artificially link the neurons in the computer by placing thirty million synapses in their proper three dimensional position. The Human Brain Project funded by European Union is attempting to provide a collaborative informatics infrastructure and first draft rodent and human whole brain models. Henry Markram is the director of both Blue Brain Project and Human Brain Project. He believes that the best way to figure out something is to try to build it from scratch.

Researchers at CereLabs believe that both approaches are essential for the success of a true AI company. We are keeping a close eye on deep learning as well as architectures like HTM. Although deep learning is giving us ready made solutions to create intelligence on your data, architectures like HTM will provide general intelligence solutions. We are betting on General Artificial Intelligence based on the concepts of neocortex. Are you?

Labels:

Comments

Post a Comment

Popular posts from this blog

How is AI Saving the Future

Meanwhile the talk of AI being the number one risk of human extinction is going on, there are lot many ways it is helping humanity. Recent developments in Machine Learning are helping scientists to solve difficult problems ranging from climate change to finding the cure for cancer. It will be a daunting task for humans to understand enormous amount of data that is generated all over the world. Machine Learning is helping scientists to use algorithms that learn from data and find patterns. Below is a list of few of the problems AI is working on to help find solutions which otherwise would not have been possible: Cancer Diagnostics : Recently, scientists at University of California (UCLA) applied Deep Learning to extract features for achieving high accuracy in label-free cell classification. This technique will help in faster cancer diagnostics, and thus will save a lot of lives. Low Cost Renewable Energy : Artificial-intelligence is helping wind power forecasts of u...
6 comments
Read more

In the World of Document Similarity

How does a human infer whether two documents are similar? This question has dazzled cognitive scientists, and is one area under which a lot of research is taking place. As of  now there is no product that is able to match or surpass human capability in finding the similarity in documents. But things are improving in this domain, and companies such as IBM and Microsoft are investing a lot in this area. We at Cere Labs, an Artificial Intelligence startup based in Mumbai, also are working in this area, and have applied LDA and Word2Vec techniques, both giving us promising results: Latent Dirichlet Allocation (LDA) : LDA is a technique used mainly for topic modeling. You c an leverage on this topic modeling to find the similarity between documents. It is assumed that more the topics two documents overlap, more are the chances that those documents carry semantic similarity. You can study LDA in the following paper: https://www.cs.princeton.edu/~blei/papers/BleiNgJordan20...
Post a Comment
Read more

Anomaly Detection based on Prediction - A Step Closer to General Artificial Intelligence

Anomaly detection refers to the problem of finding patterns that do not conform to expected behavior [1]. In the last article "Understanding Neocortex to Create Intelligence" , we explored how applications based on the workings of neocortex create intelligence. Pattern recognition along with prediction makes human brains the ultimate intelligent machines. Prediction help humans to detect anomalies in the environment. Before every action is taken, neocortex predicts the outcome. If there is a deviation from the expected outcome, neocortex detects anomalies, and will take necessary steps to handle them. A system which claims to be intelligent, should have anomaly detection in place. Recent findings using research on neocortex have made it possible to create applications that does anomaly detection. Numenta’s NuPIC using Hierarchical Temporal Memory (HTM) framework is able to do inference and prediction, and hence anomaly detection. HTM accurately predicts anomalies in real...
8 comments
Read more