Quotessence
Home / Quotes / Quote by Rasheed Ogunlaru

Quote by Rasheed Ogunlaru

“Every relationship is a part of our learning experience - including the ones that we'd rather not revisit.”

Quote by Rasheed Ogunlaru

Author

Rasheed Ogunlaru
Rasheed Ogunlaru

Rasheed Ogunlaru is a British author born on June 15, 1970. His work spans various domains including personal development, leadership, and corporate strategy. Ogunlaru is known for his unique perspective and profound insights, inspiring countless readers and audiences with his books and speeches. more

You May Also Like

“Yann LeCun's strategy provides a good example of a much more general notion: the exploitation of innate knowledge. Convolutional neural networks learn better and faster than other types of neural networks because they do not learn everything. They incorporate, in their very architecture, a strong hypothesis: what I learn in one place can be generalized everywhere else. The main problem with image recognition is invariance: I have to recognize an object, whatever its position and size, even if it moves to the right or left, farther or closer. It is a challenge, but it is also a very strong constraint: I can expect the very same clues to help me recognize a face anywhere in space. By replicating the same algorithm everywhere, convolutional networks effectively exploit this constraint: they integrate it into their very structure. Innately, prior to any learning, the system already “knows” this key property of the visual world. It does not learn invariance, but assumes it a priori and uses it to reduce the learning space-clever indeed!”

“The moral here is that nature and nurture should not be opposed. Pure learning, in the absence of any innate constraints, simply does not exist. Any learning algorithm contains, in one way or another, a set of assumptions about the domain to be learned. Rather than trying to learn everything from scratch, it is much more effective to rely on prior assumptions that clearly delineate the basic laws of the domain that must be explored, and integrate these laws into the very architecture of the system. The more innate assumptions there are, the faster learning is (provided, of course, that these assumptions are correct!). This is universally true. It would be wrong, for example, to think that the AlphaGo Zero software, which trained itself in Go by playing against itself, started from nothing: its initial representation included, among other things, knowledge of the topography and symmetries of the game, which divided the search space by a factor of eight. Our brain too is molded with assumptions of all kinds. Shortly, we will see that, at birth, babies' brains are already organized and knowledgeable. They know, implicitly, that the world is made of things that move only when pushed, without ever interpenetrating each other (solid objects)—and also that it contains much stranger entities that speak and move by themselves (people). No need to learn these laws: since they are true everywhere humans live, our genome hardwires them into the brain, thus constraining and speeding up learning. Babies do not have to learn everything about the world: their brains are full of innate constraints, and only the specific parameters that vary unpredictably (such as face shape, eye color, tone of voice, and individual tastes of the people around them) remain to be acquired.”

“It’s not simply a matter of accumulating data points, though in the early stages there is a necessity to take the raw material on-board. If anything, rather than carrying a large inventory, knowledge arrives “just in time”, without the expensive overhead of warehousing, in response to the needs of time, place, people and circumstances.”

“Children, in a very real sense, have beginners’ minds, open to wider possibilities. They see the world with fresher eyes, are less burdened with preconception and past experience, and are less guided by what they know to be true. They are more likely to pick up details that adults might discard as irrelevant. Because they’re less concerned with being wrong or looking foolish, children often ask questions that adults won’t ask.”

“The second obstacle to liberal education is our condition as heirs of intellectual traditions. Here again, it is man’s own rational nature that brings this obstacle about. Animals do not pass on their skills to their progeny in such a way that those skills can accumulate and grow. Man, and only man, does precisely that. His skills and knowledges are many-storied edifices. Each generation adds something to what has been previously built and preserved. We are proud of this fact and call it progress. And, indeed, such progress does exist in definite areas. But this very fact confronts us with the ever-present danger of sedimentation, fossilisation, or petrification of our knowledge. We are fond of pointing to the European universities of the fifteenth and sixteenth centuries which exhibit those petrifying tendencies rather clearly and are prone to exalt the fresh wind of the Renaissance and Humanism that blew all the accumulated dust away. But it behooves us to look at our own institutions of higher learning and to discern these same tendencies among us. We are not immune. This danger is inherent in all learning and all scholarship, and liberal education can never ignore it.”