SYS-CON MEDIA Authors: Pat Romanski, Gary Arora, Zakia Bouachraoui, Yeshim Deniz, Liz McMillan

News Feed Item

Multiple AI Coordination Control that Realizes Efficient Warehouse Picking by Integrating Control of Robotic Arms with AGV

Reduced operation time by 38% through coordinated continuous operation

Figure 1. Comparison of technology to remove products from an AGV using a picking robot.

Figure 2. Image of real time processing with multiple AI coordination control technology.

TOKYO, May 28, 2018 - (JCN Newswire) - Hitachi, Ltd. (TSE: 6501) today announced the development of multiple AI coordination control technology that increases the efficiency of the picking process by integrating the control of the picking robot(1) and automated guided vehicle (AGV)(2) to smoothly pick-up specific products from goods carried by the AGV. The new technology coordinates control by integrated management of the AIs that control the picking robot and the AGV, based on decisions made by the AI that determines the optimal picking method for specified products from camera(3) images. The AGV and robot arm can move closer to each other at optimal speeds to avoid collision based on the state of the goods stacked on the AGV, enabling smooth picking by the robot arm without stopping the AGV (Figure 1). The results of a comparative experiment using conventional technology where the AGV is stopped each time for picking, confirmed that the time required for picking could be reduced by 38% with the new technology. Hitachi will work towards the commercialization of a robot system for warehouse operations as well as contribute to increased efficiency in logistics through development of technology to increase the speed and automation of processes. The design of the trajectory planning and fine adjustment function for the robotic arm, necessary for this technology, was developed in collaboration with the University of Edinburgh, U.K.
Figure 1. Comparison of technology to remove products from an AGV using a picking robot.

In recent years, greater efficiency and automation in warehouse operations are in demand as they face a dramatic increase in picking operations that require specific orders to be selected from a vast range and large number of stock. AGV that carry products by case or by shelf have already been commercialized to support picking operations, and currently development of systems which combine the operation of AGV and picking robots that remove products from cases, is underway. The challenge however is that it is difficult to instantaneously determine the best way to pick up a specific product and control the picking robot while taking into consideration the speed of the AGV as goods in the cart become disarrayed during picking and transport. Thus, it was necessary to stop the AGV before starting picking operations resulting in a time loss while the AGV is stopped which added to the difficulty of establishing more efficient systems. To address this challenge, Hitachi developed the multiple AI coordination control technology to optimize the efficiency of the picking process by coordinating the picking robot and the AGV.

Features of the technology are as follows:

(1) AI determining the optimal picking method from camera images

AI was developed that determines from camera images, the position of a product which can be picked by a picking robot from how goods are stacked in a case and the speed of the AGV. By inputting 3D data of product to be picked before the operation, the AI simulates several tens of thousands of ways that the robotic arm could pick a product from randomly generated various states of stacked goods transported at various speeds. Based on the results of the simulation, the AI automatically generates image processing analysis training data(4) for deep learning(5) to analyze the information necessary to determine how to control the picking robot and the AGV, that is, determine the position of products which change with the state of how goods are stacked as well as the adjustment required in AGV speed. This system can be implemented and operated efficiently as the AI is not required to learn during the actual picking operation, it can be implemented and operated efficiently.

(2) Real-time multiple AI coordination control

Technology was developed to coordinate and control in real-time the AI for the robotic arm as well as the AI for the AGV, based on the AI that determines the optimal picking method from images of goods within cases taken as the AGV approaches the picking robot. This technology instructs the arm movement calculated from the position of the product to be picked to the AI that controls the picking robot, and instructs the AI controlling the AGV to accelerate or decelerate based on current speed. Further, the AI for the picking robot can confirm the speed and the location of the AGV in real time and conducts minor adjustments to prevent the arm from colliding with the case or other products, thus enabling efficient automatic picking as the AGV does not need to be stopped. (Figure 2)
Figure 2. Image of real time processing with multiple AI coordination control technology.

An in-house experiment utilizing this technology resulted in successful picking from AGV which moved non-stop at a speed of 0.5 meters per second. Further, it was found that by employing the new technology, the procedure which required 13 seconds with the conventional method of stopping the AGV to pick products, could be achieved in 8 seconds, a 38% improvement in speed.

Comment from Professor Sethu Vijayakumar FRSE, Personal Chair of Robotics at Edinburgh University and Director of the Edinburgh Centre for Robotics

"We are delighted to see the successful results of more than two years of collaboration with the Hitachi R&D Group, Center for Technology Innovation, culminating in practical and deployable improvements in automated warehousing technology. Our robotics lab has been at the forefront of machine learning techniques for adaptive motion planning and control of complex multi-DOF robots and this provides an excellent opportunity to see this expertise used to solve real world problems."

Hitachi will continue efforts to contribute increasing logistic efficiency by working towards the commercialization of this technology as well as integrating it into its AGV, Racrew(6) and autonomous moving robot, HiMoveRO(7), among others.

(1) Picking is the operation of gathering goods and products according to electronic data and instructions such as at distribution warehouses and manufacturing plants, etc.
(2) An automated or automatic guided vehicles (AGV) transports boxes and shelves containing products to specified locations.
(3) A camera which can photograph RGB-D images as each pixel has both information on color (RGB) and distance (depth).
(4) Training data is used to teach machines to output appropriate answers to input data.
(5) Deep learning is a type of machine learning that mimics mechanisms of the brain's neural circuit. It is comprised of three elements: the input layer, hidden layers, and the output layer. By increasing the number of hidden layers, deep learning is capable of expressing complex models relative to conventional machine learning, and has displayed a high recognition rate in fields such as speech recognition, image recognition, etc.
(6) Racrew is a registered trademark of Hitachi, Ltd. in Japan.
(7) HiMoveRO is a registered trademark and product of Hitachi Plant Mechanics Co., Ltd. in Japan. (in Japanese)

About Hitachi, Ltd.

Hitachi, Ltd. (TSE: 6501), headquartered in Tokyo, Japan, delivers innovations that answer society's challenges with our talented team and proven experience in global markets. The company's consolidated revenues for fiscal 2014 (ended March 31, 2015) totaled 9,761 billion yen ($81.3 billion). Hitachi is focusing more than ever on the Social Innovation Business, which includes power & infrastructure systems, information & telecommunication systems, construction machinery, high functional materials & components, automotive systems, healthcare and others. For more information on Hitachi, please visit the company's website at

Source: Hitachi, Ltd.

Hitachi Ltd
Corporate Communications
Tel: +81-3-3258-1111

Copyright 2018 JCN Newswire . All rights reserved.

More Stories By ACN Newswire

Copyright 2008 ACN Newswire. All rights reserved. Republication or redistribution of ACN Newswire content is expressly prohibited without the prior written consent of ACN Newswire. ACN Newswire shall not be liable for any errors or delays in the content, or for any actions taken in reliance thereon.

Latest Stories
DevOps has long focused on reinventing the SDLC (e.g. with CI/CD, ARA, pipeline automation etc.), while reinvention of IT Ops has lagged. However, new approaches like Site Reliability Engineering, Observability, Containerization, Operations Analytics, and ML/AI are driving a resurgence of IT Ops. In this session our expert panel will focus on how these new ideas are [putting the Ops back in DevOps orbringing modern IT Ops to DevOps].
While a hybrid cloud can ease that transition, designing and deploy that hybrid cloud still offers challenges for organizations concerned about lack of available cloud skillsets within their organization. Managed service providers offer a unique opportunity to fill those gaps and get organizations of all sizes on a hybrid cloud that meets their comfort level, while delivering enhanced benefits for cost, efficiency, agility, mobility, and elasticity.
Isomorphic Software is the global leader in high-end, web-based business applications. We develop, market, and support the SmartClient & Smart GWT HTML5/Ajax platform, combining the productivity and performance of traditional desktop software with the simplicity and reach of the open web. With staff in 10 timezones, Isomorphic provides a global network of services related to our technology, with offerings ranging from turnkey application development to SLA-backed enterprise support. Leadin...
Darktrace is the world's leading AI company for cyber security. Created by mathematicians from the University of Cambridge, Darktrace's Enterprise Immune System is the first non-consumer application of machine learning to work at scale, across all network types, from physical, virtualized, and cloud, through to IoT and industrial control systems. Installed as a self-configuring cyber defense platform, Darktrace continuously learns what is ‘normal' for all devices and users, updating its understa...
Enterprises are striving to become digital businesses for differentiated innovation and customer-centricity. Traditionally, they focused on digitizing processes and paper workflow. To be a disruptor and compete against new players, they need to gain insight into business data and innovate at scale. Cloud and cognitive technologies can help them leverage hidden data in SAP/ERP systems to fuel their businesses to accelerate digital transformation success.
Concerns about security, downtime and latency, budgets, and general unfamiliarity with cloud technologies continue to create hesitation for many organizations that truly need to be developing a cloud strategy. Hybrid cloud solutions are helping to elevate those concerns by enabling the combination or orchestration of two or more platforms, including on-premise infrastructure, private clouds and/or third-party, public cloud services. This gives organizations more comfort to begin their digital tr...
Most organizations are awash today in data and IT systems, yet they're still struggling mightily to use these invaluable assets to meet the rising demand for new digital solutions and customer experiences that drive innovation and growth. What's lacking are potent and effective ways to rapidly combine together on-premises IT and the numerous commercial clouds that the average organization has in place today into effective new business solutions.
Keeping an application running at scale can be a daunting task. When do you need to add more capacity? Larger databases? Additional servers? These questions get harder as the complexity of your application grows. Microservice based architectures and cloud-based dynamic infrastructures are technologies that help you keep your application running with high availability, even during times of extreme scaling. But real cloud success, at scale, requires much more than a basic lift-and-shift migrati...
David Friend is the co-founder and CEO of Wasabi, the hot cloud storage company that delivers fast, low-cost, and reliable cloud storage. Prior to Wasabi, David co-founded Carbonite, one of the world's leading cloud backup companies. A successful tech entrepreneur for more than 30 years, David got his start at ARP Instruments, a manufacturer of synthesizers for rock bands, where he worked with leading musicians of the day like Stevie Wonder, Pete Townsend of The Who, and Led Zeppelin. David has ...
Darktrace is the world's leading AI company for cyber security. Created by mathematicians from the University of Cambridge, Darktrace's Enterprise Immune System is the first non-consumer application of machine learning to work at scale, across all network types, from physical, virtualized, and cloud, through to IoT and industrial control systems. Installed as a self-configuring cyber defense platform, Darktrace continuously learns what is ‘normal' for all devices and users, updating its understa...
Dion Hinchcliffe is an internationally recognized digital expert, bestselling book author, frequent keynote speaker, analyst, futurist, and transformation expert based in Washington, DC. He is currently Chief Strategy Officer at the industry-leading digital strategy and online community solutions firm, 7Summits.
Addteq is a leader in providing business solutions to Enterprise clients. Addteq has been in the business for more than 10 years. Through the use of DevOps automation, Addteq strives on creating innovative solutions to solve business processes. Clients depend on Addteq to modernize the software delivery process by providing Atlassian solutions, create custom add-ons, conduct training, offer hosting, perform DevOps services, and provide overall support services.
Contino is a global technical consultancy that helps highly-regulated enterprises transform faster, modernizing their way of working through DevOps and cloud computing. They focus on building capability and assisting our clients to in-source strategic technology capability so they get to market quickly and build their own innovation engine.
When applications are hosted on servers, they produce immense quantities of logging data. Quality engineers should verify that apps are producing log data that is existent, correct, consumable, and complete. Otherwise, apps in production are not easily monitored, have issues that are difficult to detect, and cannot be corrected quickly. Tom Chavez presents the four steps that quality engineers should include in every test plan for apps that produce log output or other machine data. Learn the ste...
Digital Transformation is much more than a buzzword. The radical shift to digital mechanisms for almost every process is evident across all industries and verticals. This is often especially true in financial services, where the legacy environment is many times unable to keep up with the rapidly shifting demands of the consumer. The constant pressure to provide complete, omnichannel delivery of customer-facing solutions to meet both regulatory and customer demands is putting enormous pressure on...