The “AI Suitcase” is an autonomous, navigation robot that guides visually impaired people. It looks like a commercially available suitcase, yet it can recognize obstacles and people to guide the visually impaired user safely to their destination. We are improving its functions through collaboration with partners.
The “AI Suitcase” Introduction Video
(The video is divided into two parts; the second half shows the same footage as the first, but with audio description.)
How the “AI Suitcase” Works
The AI Suitcase incorporates various features in order to guide users safely, and to make it easy for those with visual impairments to operate.
How to Use
Using a smartphone with the dedicated app installed, users can set their destination by swiping the display or using voice commands. Users can also navigate to multiple destinations, as if on a tour. After setting the destination, users can press the start button on the handle and hold it to make the AI Suitcase begin navigate. There is a sensor on the bottom of the handle that tells the suitcase to move or to stop. While the suitcase is navigating, its speed can be adjusted with buttons, and you can tell in which direction the suitcase is going to turn by the vibration of small plates on either side of the handle.
How Navigation Works
To guide the user to their destination, the AI Suitcase needs to accurately determine its own position, and choose a safe route according to the surrounding conditions. The LiDAR (Light Detection and Ranging) sensor is a device that uses lasers to accurately measure the distance to surrounding walls and obstacles, and can even ascertain their rough shapes. By comparing the shapes of walls measured in real time to pre-existing measurement data, it can determine its current position as well as the locations of obstacles. Its RGB-D cameras (depth cameras) can detect the distance to objects. Image-recognizing AI allows the system to identify pedestrians and their movements.
Based on the information from these devices, the AI Suitcase calculates the safe route using a computer equipped with a GPU (Graphics Processing Unit) that can process huge amounts of data at high speed.
How the “AI Suitcase” Moves Outdoors
Outdoors, there are few walls to help determine where the suitcase is, so positioning using only the LiDAR sensor is insufficient. An antenna that receives satellite signals has been added to the outdoor model. Its position is calculated using a technology known as real-time kinematic positioning, which accurately determines position based on satellite signals and data from reference stations on the ground which aids to correct for radio wave interference.
“Walking with the “AI Suitcase” through Permanent Exhibits”
Demonstrations are held every day (except days when the museum is closed) in which you can experience using the AI Suitcase to navigate through the permanent exhibition area. Anyone can participate, not just those with visual impairments.
There are two types of experience, of which you can choose between at the time of registration. Tours begin and end at the “AI Suitcase Station” next to the general information desk on the 3rd floor.
① “Planetary Crisis” Tour （Time required: 25-40 minutes）
This is a tour of the exhibit “Planetary Crisis – To Continue Living on This Earth”, themed on the global environment and located on the 5th floor of the permanent exhibition. You can enjoy at your own pace while experiencing the touchable exhibits.
② Free Choice Tour（Time required: 15-20 minutes）
This tour allows you to freely choose about 3 out of the 18 exhibits on the 3rd and 5th floors of the permanent exhibition. You can enjoy navigating through the spacious exhibition floor with the AI Suitcase as you tour an assortment of exhibits that interest you.
- Separate from the tour, there will be time (about 15 minutes) for an explanation of how to participate in the experience, as well as to fill out a questionnaire.
- Depending on the volume of reception the day of, the experience route may be limited.
- Date and Time
-
Every day except for close days, from 10:30 a.m., 1:30 p.m., and 3:30 p.m. (three times a day)
- Each course lasts 30-55 minutes, including time for explanation of experience and answering a questionnaire
- How to Participate
-
Please register at the “AI Suitcase Station” next to the general information desk on the 3rd floor. The registration begins 20 minutes before the start of each session.
If you are visually impaired, you can make a reservation up to three weeks before the experience date. Please check the requirements for participation, possible number of participants, and points to note below, and then contact us using the phone number for inquiries （TEL:03-3570-9151）. On opening days, our phone support hours are 10 a.m. to 5 p.m.
- If there are a large number of applicants when reservations open on the day of, a lottery will be held. Depending on the volume of reservations, registration may close before the opening time for reservations for each session.
- Participation Fee
-
The entrance fee
- Admission is free for holders of a physical disability certificate and for their caregivers (one person per certificate holder).
- Participation Requirements
-
Visitors who have no anxiety or difficulty in walking and listening to the audio guide
Recommended height 130cm or taller- Please contact us if you are under 130 cm in height and wish to participate.
- Number of Participants
-
1-4 persons per tour
- One or two AI Suitcase(s) will be in operation depending on the situation on the day.
- Points to Note
-
- Participants will be asked to sign a consent form at the museum on the day of the visit. In addition, a parent or guardian’s signature is required for minors to participate in the experience.
- This event is a proof-of-concept demonstration that contributes to the research and development of the AI Suitcase. We ask those participating in the experience to fill in a questionnaire.
- We may be forced to cancel the event due to the state of the equipment, etc.
- If you make a reservation in advance, but do not arrive on time, your reservation may be cancelled and other guests may be given priority.
- Cooperation
-
Consortium for Advanced Assistive Mobility Platform (CAAMP)
- Inquiries
-
Miraikan - The National Museum of Emerging Science and Innovation
TEL:03-3570-9151
Contact through the Internet
Development of the AI Suitcase
During a business trip, Miraikan Chief Executive Director and IBM Fellow Dr. Chieko Asakawa, who is blind, had an idea: What if her suitcase could act as an automated guide? She began developing her idea in 2017 in the research lab at Carnegie Mellon University, where she was a visiting professor. Then, in 2019, IBM Japan and other companies in support of her objectives and formed the Consortium for Advanced Assistive Mobility Platform (CAAMP) and moved toward development. After Dr. Asakawa was appointed Chief Executive Director of Miraikan in April 2021, Miraikan became one of the base for research & development and field trial.
Key Field Trials
| Mar 2021 | First field trial with users at an office (Organized by IBM Japan) |
|---|---|
| Nov 2021 | Field trial at the Pittsburgh Airport (Organized by Carnegie Mellon University) |
| Jul 2022 | Hands-on experience at Miraikan (Organized by Miraikan) |
| Jul 2022 | Field trial at the New Chitose Airport (Organized by Miraikan) |
| Aug 2022 | Field trial with subway and commercial buildings in the Nihonbashi Muromachi area of Tokyo (Organized by CAAMP) |
| Jan 2023 | First outdoor trial run, on Miraikan grounds and at Promenade Park (Organized by Miraikan, the Tokyo Metropolitan Government, and the Digital Innovation City Association) |
| Mar 2023 | Demonstration at CSUN Assistive Technology Conference 2023 |
| Apr 2023 | Demonstration at “The Digital and Tech Exhibition” at G7 Digital and Tech Ministers’ Meeting in Takasaki, Gunma |
| Sep 2023 | First indoor/outdoor trial run and in-facility operational trial, at Miraikan and Promenade Park (Organized by Miraikan, the Tokyo Metropolitan Government, and the Digital Innovation City Association) |
| Apr 2024 | Start of regular pilot service at Miraikan |
Advanced Assistive Mobility Platform