Joint development of remote on-site support system for active use of MR in Huize high pressure concrete and honeycomb laboratory

Huize High pressure concrete Co., Ltd. (headquarters: Hokkaido Komori City, Chairman: Yoshihiro Uizawa, hereinafter referred to as "Hizawa High pressure") and Honeycomb Lab (headquarters: Shibuya District, Tokyo, Chairman: Qingwa Kawahara, hereinafter referred to as "Honeycomb Lab") are Trimble XR10 (helmet integrated equipment carried by HoloLens 2). The following "XR10") is jointly developed by using the remote on-the-spot support system (hereinafter referred to as "this system"). Recently, in the public utilities ordered by Sapporo City, under the hands of the staff of the city, the remote on-the-spot implementation of the system has been implemented.

Huize High Voltage × Honeycomb Laboratory

The background of joint development

Composite reality (Mixed Reality, hereinafter referred to as "MR") is a technology that presents virtual objects in front of your eyes by using a wearable special display represented by Microsoft's "HoloLens". In the real space of production and construction, digital documents, drawings and images can emerge, so it is expected to manage the production and construction site remotely and greatly improve business efficiency.

Centering on the group's first-tier architect firm ADAAC Co., Ltd. (headquartered in Tokyo), Huize High pressure promotes DX (digital conversion) in the field of construction and civil engineering, with the goal of developing new applications of MR, and has been working with cellular laboratories since about a year ago.

Cellular Lab specializes in system development using 3D and MR technologies and received MRPP certification in 2017, the MRPP is Microsoft's official development partner for HoloLens and MR deployed around the world.

Remote presence based on this system

Remote site refers to the two-way communication of images and sounds such as mobile terminals at the construction site and production site, and the "stage confirmation", "material confirmation" and "witness" that are usually carried out remotely in public utilities.

The system developed for remote site consists of three parts: the PC used by the order in the government office, the helmet integrated MR equipment "XR10" used by the surveyor in the field, and the iPad used by the field commander to manage the overall progress of the on-site operation and relay it to the government.

The situation of the PC screen. The picture on the right is across the XR10, the lower left is the picture shown on iPad, and the upper left is the picture taken by iPad's camera.

When ordering public utilities, the orderers regularly go to the manufacturing and construction site of concrete components to confirm whether the operation is carried out in accordance with the contract, confirm and witness. Using this system, you can know the situation of the scene through the image of iPad while in the office, and you can also confirm in detail the condition in the hands of the surveyor reflected by XR10. The biggest advantage is to place the checklist and drawings of the inspection project on the screen and work at the same time shared by all relevant people. In addition, even if the inspection factory spans more than one, it can also be dealt with by switching the screen, which can greatly improve the operation efficiency and shorten the time compared with the past.

Remotely confirm the situation on the spot

The surveyors at the scene wear helmets and integrated MR equipment "XR10" to carry out measurements. MR technology shows the drawings and measurement items of the current measurement position in the space in front of the surveyor, and the surveyor can make the measurement at the same time. In addition, the measurements are taken in real time by XR10's camera and sent to the screen of the PC browser. The XR10 is hands-free, so surveyors are free to use their hands and focus on measuring and shooting.

Field surveyor who installs XR10

At the same time, the on-site commander will carry out the entire inspection while selecting the inspection items on the iPad. While communicating with the orderers in the office, the on-site commander can immediately share the measurement results entered with the office, which is efficient and can carry out paperless inspection. In addition, the iPad camera can also use XR10 to send real-time video of field surveyors to ensure the accuracy of the measurement data.

Field commander with iPad and field surveyor for measurement

Huize High Voltage × Honeycomb Laboratory

< reference video >

Holo Inspection

Https://www.youtube.com/watch?v=AgJ36T5tjQ4

The process of realizing the remote witness of the active use of MR

This time, the remote legislative project for the active use of MR is based on the laying of large-scale dividing boxes and culverts ordered by the sewer and river bureau of Sapporo City, which is mainly the "disaster Prevention and Safety subsidy undertaking Class 1 River Yanlai River Reconstruction Project." Because of the streamline along the river, the on-site construction is very difficult and the existing roads need to be opened as soon as possible. In addition, there are also buried objects under the box, using prefabricated products that are thinner than the top plate hit on the spot.

"that 1 Project" (former contractor: Mr. Tanaka Group Co., Ltd.) is an order based on the production of prefabricated components, and each product type needs to be inspected on site in the factory. However, the manufacturing plant is divided into two plants, which is a long distance from Sapporo City, based on this situation, in which remote work in corona accidents is recommended in order to suppress as much traffic as possible to the production plant. As Huize high pressure, we proposed the first remote on-site inspection to Mr. Tanaka. I got Sapporo's forgiveness.

Engineering drawing

First, the project.

The "Project 1" was made before the use of 34 cases (68 pieces) out of a total of 40 cases, and the remote interview will be carried out on March 26, 2003. The headquarters of the Provisional Legislative Council was set up at the Asawa Institute of Technology in Sapporo, and the Sapporo City Supervisor and the Tanaka team remotely confirmed the images from the temporary headquarters and held a meeting. On the other hand, in the production factory, two fixed-point cameras are used for panoramic shooting and one mobile device for measurement is used to take measurements. Formwork inspection, reinforcement fog inspection, reinforcement inspection, raw concrete character confirmation, raw concrete setting condition confirmation, appearance size inspection, compressive strength test, etc., cover all items.

會澤高圧コンクリートとハニカムラボ  MR活用の遠隔臨場支援システムを共同開発

Third, engineering.

This time, the "third Project" (original contractor: Yong Construction sample), which adopted MR equipment for the first time, is a project mainly for laying large-scale two-split box culverts. This is a trial project of "remote presence" recommended by Sapporo City, with the manufacture of 2 kinds of 3 cases each.

Ling he took panoramic photography on two former fixed-point cameras on May 19, 2003, in the form of a measurement with a mobile device. On June 18, 2003, the system was implemented using XR10. After that, we plan to use this system for remote on-site inspection for MR equipment.

The voice of the orderer and the original contractor

Yoshiki Hashimoto, an orderer from the River Engineering Department of the River cause Promotion Department of the Sapporo City Sewerage and River Bureau, said, "I can strongly feel the business improvement effect brought about by the reduction in mobile time." You can confirm the overall condition of the inspection with a fixed-point camera while confirming the details of the inspection through the image of the hologram lens, so the reliability is very high. Kudo Wan, the acting chief of the Engineering Section of the Yong Construction Engineering Department, said, "the shortage of manpower on the site has been slow, which is of great reference value as a measure leading to saving people."

About the prospect of the future

On the application of MR in building civil engineering, Huize High pressure concrete Chairman Huizawa Xianghong said, "the real space of MR is always main, where digital objects can be combined in a variety of ways, with high affinity with architecture, and become one of the important tools to promote architectural DX. First of all, from the digital, remote, efficient place to start the existing witness, etc., but all the designs are three-dimensional data, in the future, the manufacture and logistics of concrete components, as well as the construction phase of the site will also be used continuously. The design data of large-scale prefabricated products form a pair with spot prefabricated products in an one-to-one ratio, instantly judge the dimensional accuracy of the products, and the complete automation of quality control will also enter the field of vision.

What is Trimble XR10?

Microsoft's HoloLens 2 is a helmet that conforms to the standards for protective caps and insulation protection tools stipulated by the Ministry of Health and Labor, as well as construction site equipment for bone conduction headphones. The Microsoft HoloLens is the world's first independent holographic computer and a new headset that can interact with holograms displayed in the real world. From January 2017, Microsoft began to provide services to its domestic companies and developers.

* Note: Trimble XR10 helmets are the following qualified helmets and will be shipped with ring rope (chin rope) and impact absorption gasket.

1. Standard test for preventing hazards caused by flying or falling or falling of objects

two。 Voltage withstand test used to prevent or reduce the risk of head electric shock

About Honeycomb Lab

The corporate vision is to "realize a joyful future and a convenient and happy society".

Members with all kinds of skills come together to solve many problems and ideas in the world through the power of creativity and technology, using unprecedented user experience, amazing social performance, and building mechanisms to support the foundation. in order to achieve a happy future.

Mainly good at xR (VR/AR/MR), digital signage and other interactive content, as well as the development of smartphone applications, responsible for the planning and development of many enterprise digital promotion and activities, permanent display content of commercial facilities, etc. There are also many award-winning resumes for advertising awards at home and abroad.

< company profile >

Company name: Honeycomb Lab. Inc.)

Representative: chairman Qinghe Kawahara

Address: zip code: 151-0053 Shibuya District, Tokyo 1-15-7 Castle Yogi 4F

Official website: https://www.honeycomb-lab.co.jp/

About Huize high pressure concrete

Under the business philosophy of Innovate Challenge Trust, a comprehensive concrete manufacturer who multiplies concrete materials with cutting-edge technology and is committed to creating new enterprise value. New machine shafts such as self-healing concrete (Basilisk) using the metabolic function of bacteria to repair cracks (cracks) and concrete 3D printers using quick-drying cement materials have been cooperated with MIT and Delft University of Technology. We build DX from traditional materials industry to innovative marketing groups based on smart materials. Sales (individual units) in March 2021 were 20.3 billion yen. 618 employees.

< company profile >

Company name: Huize High pressure concrete Co., Ltd. (AIZAWA Concrete Corporation)

Representative: chairman Huizawa Yoshihiro

Location: 3-1-4, Ruocao town, Hokkaido, Hokkaido, 0021

Official website: https://www.aizawa-group.co.jp