Team Uses Drones To Inspect Irrigation Canals for Japanese Rice Farms

Kenji Shimada, professor of mechanical engineering at Carnegie Mellon University, and his team of engineers are using unmanned aerial vehicles, also known as drones, to detect damage to agricultural water canals in a town in Niigata, an agricultural district on the northwest coast of Japan's main island. These canals are essential for the rice farming economy in the region and total approximately 40,000 kilometers throughout Japan.

Damage to the canals accumulates annually due to age, earthquakes and extreme weather. They can only be analyzed and repaired during the two-month dry season each year. Of these two months, one and a half of them are devoted to laborious inspection by technicians who walk along the canals to manually identify, measure and record damaged areas. This leaves only half a month for repairs.

"40,000 kilometers are equivalent to the equatorial circumference of Earth, and the manual labor for inspecting and evaluating the condition of water canals is enormous," Shimada said. "We automate the work by flying autonomous drones equipped with high-resolution cameras and detecting cracks and wear with machine learning algorithms."

Shimada and his team have developed a systematic framework with a fleet of drones and coordinating cars to assess the canals effectively and efficiently, extending the coverage area and minimizing inspection time. Di Deng, a Ph.D. candidate in mechanical engineering, works on the coverage planning aspect of the project. Last year, she traveled to Japan to conduct field tests of the drone in different types of water canals.

"Over the summer, we flew our autonomous drone in Japan and tried different sizes of water canals, so the system can automatically decide the position of the drone inside the water canals," Deng said. "We tried out the widths of the water canals that go from 5 meters to 2.4 meters. We could clearly see a lot of stone exposed, so these were the places we needed to repair."

The research team used public maps to help create an algorithm to plan the drones' path along the canals. 

Using public maps and research data, the research team has formulated an algorithm to plan the drones' path along the canals. They can fly along canals of different sizes in multiple directions to record complete video of the walls for crack detection. The type of commercial drone chosen for the project is limited to 30 minutes in the air and must stay within a range of a few kilometers from the remote controllers. They are paired with parked cars nearby that provide batteries and coordinate to retrieve the drones when needed.

Once the drones have recorded video of the entire canal, the data from the images is fed into a neural network to detect damaged areas and map them in models. To plan the paths of the drones, a scaled map of a canal is converted to a graph. This graph is then divided into subgraphs, which represent the areas they will cover. The team also graphs the roads to generate a route for the car that is within communication distance of the drones. The cars are programmed to automatically find alternative routes if faced with traffic.

The team presented their research at the International Conference on Intelligent Robots and Systems (IROS) in October. In the future, they plan to tackle potential roadblocks. In addition to the battery and time limitations, logical challenges to this project include potential vehicle collisions, aerial constraints (i.e.: flying zones, aerial traffic, and other regulations), and inaccurate maps and measurements. Another long-term goal is to develop large-scale automated vehicle planning.

"We believe that this type of technology is critical to keeping the aging infrastructures healthy and safe — it enables faster, cheaper, and more regular inspection and monitoring," Shimada said.

Carnegie Mellon University is committed to educating, empowering and aligning its community around the world to address the Sustainable Development Goals, also known as the Global Goals, which aim to create a more peaceful, prosperous planet with just and inclusive societies. Recognizing the critical contributions that universities are making through education, research and practice, CMU publicly committed to undertaking a Voluntary University Review of the Global Goals. The 17 Global Goals cover wide-ranging issues, including reducing violence, ending extreme poverty, promoting equitable education, fighting inequality and injustice, advancing economic growth and decent work, and preventing the harmful effects of climate change by 2030.

The preceding story demonstrates CMU's work toward attaining Global Goals 8 and 9.