Articles

Making RL tractable by learning more informative reward functions: example-based control, meta-learning, and normalized maximum likelihood

Diagram of MURAL, our method for learning uncertainty-aware rewards for RL. After the user provides a few examples of desired outcomes, MURAL automatically infers a reward function that takes into account these examples and the agent’s uncertainty for each state. Although reinforcement learning has shown success in domains such as robotics, chip placement and playing …

Making RL tractable by learning more informative reward functions: example-based control, meta-learning, and normalized maximum likelihood Read More »

What can I do here? Learning new skills by imagining visual affordances

How do humans become so skillful? Well, initially we are not, but from infancy, we discover and practice increasingly complex skills through self-supervised play. But this play is not random – the child development literature suggests that infants use their prior experience to conduct directed exploration of affordances like movability, suckability, graspability, and digestibility through …

What can I do here? Learning new skills by imagining visual affordances Read More »

We used peanuts and a climbing wall to learn how squirrels judge their leaps so successfully – and how their skills could inspire more nimble robots

How do they stick their landings? Alex Turton via Getty Images Tree squirrels are the Olympic divers of the rodent world, leaping gracefully among branches and structures high above the ground. And as with human divers, a squirrel’s success in this competition requires both physical strength and mental adaptability. The Jacobs lab studies cognition in …

We used peanuts and a climbing wall to learn how squirrels judge their leaps so successfully – and how their skills could inspire more nimble robots Read More »

Slender robotic finger senses buried items

MIT researchers developed a “Digger Finger” robot that digs through granular material, like sand and gravel, and senses the shapes of buried objects. The technology could aid in disarming buried bombs or inspecting underground cables. Image courtesy of the researchers. By Daniel Ackerman Over the years, robots have gotten quite good at identifying objects — …

Slender robotic finger senses buried items Read More »

Towards mapping unknown environments with a robot swarm

Mapping is an essential task in many robotics applications. A map is a representation of the environment generated from robots positions and sensors data. A map can be either used to navigate the robot that built it, or shared with other agents: humans, software, or robots. To build a map, it is frequently assumed that …

Towards mapping unknown environments with a robot swarm Read More »

Soft robots for ocean exploration and offshore operations: A perspective

Most of the ocean is unknown. Yet we know that the most challenging environments on the planet reside in it. Understanding the ocean in its totality is a key component for the sustainable development of human activities and for the mitigation of climate change, as proclaimed by the United Nations. We are glad to share …

Soft robots for ocean exploration and offshore operations: A perspective Read More »

Robotic swarm swims like a school of fish

Bluebots are fish-shaped robots that can coordinate their movements in three dimensions underwater, rather than the two dimensions previously achieved by Kilobots. Credit: Harvard SEAS By Leah Burrows / SEAS Communications Schools of fish exhibit complex, synchronized behaviors that help them find food, migrate, and evade predators. No one fish or sub-group of fish coordinates …

Robotic swarm swims like a school of fish Read More »

How to keep drones flying when a motor fails

Robotics researchers at the University of Zurich show how onboard cameras can be used to keep damaged quadcopters in the air and flying stably – even without GPS. As anxious passengers are often reassured, commercial aircrafts can easily continue to fly even if one of the engines stops working. But for drones with four propellers …

How to keep drones flying when a motor fails Read More »

Showing robots how to drive a car… in just a few easy lessons

If robots could learn from watching demonstrations, your self-driving car could learn how to drive safely by watching you drive around your neighborhood. Photo/iStock. By Caitlin Dawson USC researchers have developed a method that could allow robots to learn new tasks, like setting a table or driving a car, from observing a small number of …

Showing robots how to drive a car… in just a few easy lessons Read More »