November 14, 2024 The sun rises from Anatolia

Using Artificial Intelligence to Create a 3D Model of a Lost Temple Relief from a 134-Year-Old Photograph

Researchers have developed a neural network capable of taking a single 2D photo of a three-dimensional object and producing a digital reconstruction in three dimensions. This method has the potential to revolutionize digital preservation, especially for artifacts that are hidden, too delicate for traditional 3D modeling, or too fragile to be excavated.

In a way, scientists have created a 21st-century stereoscope. Last month, at the 32nd ACM Multimedia conference, the team presented their proof-of-concept.

A research team at Ritsumeikan University led by Professor Satoshi Tanaka along with Dr. Jiao Pan, from the University of Science and Technology Beijing, used a 134-year-old photograph from the Borobudur Temple in Indonesia to demonstrate the incredible work this neural network can perform.

The largest Buddhist temple in the world, Borobudur is covered in 2,672 relief panels. Built in the 9th century CE, it was eventually abandoned, only to be discovered centuries later by Dutch archeologists.

Image Credit: Pan et al. 2024

The relief, found on the ground level of the famed Borobudur Temple a UNESCO World Heritage site, depicts a group of people in traditional attire set against a backdrop of trees and ancient architecture. It was only known by a black-and-white photo that was taken in the 19th century while the relief was exposed during reconstruction work. It was then covered over by reinforcement walls.

The recent team’s neural network managed to reconstruct one of those now-hidden reliefs using an old black-and-white photo from 134 years ago.

A depth map of the temple relief. Image Credit:: Pan et al. 2024

Although earlier reconstructions had been attempted, they were unable to capture the finer details of the reliefs. These three-dimensional reliefs contain detail from the carvings closest to the viewer and farthest from the viewer, and prior reconstruction attempts flattened out the details at these varying depths, resulting in the loss of those details due to the compression of depth values. Based on the computed curvature changes in the 3D space, the team created a map of the lost characteristics, which they called “soft edges.”

“Our multi-task neural network successfully reconstructed these hidden sections of Borobudur’s ground-level reliefs from surviving old photographs. Through computer visualization and virtual reality, our research now allows virtual exploration of these unseen treasures,” says Prof. Tanaka.

A soft-edge map (left) and semantic map (right) of the 2d relief image Credit: Pan et al. 2024

By enhancing the depth estimation, particularly around soft edges, they were able to produce images that more accurately represent the original reliefs. The technique is a breakthrough, as 3D scanning and photogrammetry can only record reliefs in their current state, whereas 3D digital restoration returns us to the original.
“Our technology holds vast potential for preserving and sharing cultural heritage,” shares Prof. Tanaka. “It opens new opportunities not only for archeologists but also for immersive virtual experiences through VR and metaverse technologies, preserving global heritage for future generations.”

DOI: 10.1145/3664647.3681612

Ritsumeikan University

Cover Image Credit: Terrace on the temple of Borobudur 1913. Wikipedia Commons

Banner
Related Articles

3 Roman tombs found during foundation excavation

August 4, 2024

August 4, 2024

During the excavation of the foundation of a building construction, 3 graves belonging to the Roman period were found. It...

A floor mosaic thought to be from the Roman period, which the field owner found by chance while planting saplings, came to light

September 26, 2024

September 26, 2024

The work on a floor mosaic, thought to belong to the Roman or Early Byzantine period, which a farmer in...

A 14,500-year-old offering pit found in the Gedikkaya Cave

October 13, 2023

October 13, 2023

In the rescue excavation conducted in Gedikkaya Cave in the İnhisar district of Bilecik, a 14,500-year-old offering pit was discovered....

The 1000-year-old balbals in Çivril bear the traces of Turkish civilization and belief system

March 31, 2024

March 31, 2024

The balbals in Özdemirci Cemetery in Çivril district of Denizli continue to attract the attention of history buffs and archaeologists....

The United States announced that an artwork, which was revealed to have been smuggled from Türkiye, will be returned

September 6, 2023

September 6, 2023

In the context of a stolen historical artifact operation in the USA, it was announced that an artwork, which was...

Twelve pipes that supplied water to the ancient city of Antiocheia have been uncovered from the Late Roman Period

October 16, 2024

October 16, 2024

In the ongoing rescue excavations at the ancient city of Antiocheia, located in Hatay province in southern Türkiye, twelve pipes...

The relief, which is considered to belong to the Sun god Helios, was found during infrastructure works

September 2, 2023

September 2, 2023

A headless relief thought to belong to the Sun God Helios was found during the infrastructure works carried out in...

A statue believed to depict the Roman emperor Marcus Aurelius, looted from Turkey, has been ordered seized from the Cleveland Museum of Art

September 1, 2023

September 1, 2023

New York officials investigating looted antiquities from Turkey have ordered the seizure of a bronze statue believed to depict the...

Evil spirits in the belief of Khakass Turks

January 4, 2024

January 4, 2024

The Khakass Turks are a nomadic Turkic tribe inhabiting the region along the Yenisei River from the Sayan mountains to...

The city that witnessed the immortal friendship of an orphan and a dolphin: Iasos

May 10, 2024

May 10, 2024

The city of Iasos, whispered by the waves of the Aegean Sea, bearing the traces of history and mythology, is...

The drought in Lake Iznik revealed the submerged basilica

September 25, 2023

September 25, 2023

The drought in Turkey led to the water levels of Lake Iznik receding. With the receding water, the basilica considered...

Gökhöyük might possess a settlement that will shed light on the 7000-year history of Central Anatolia

August 17, 2023

August 17, 2023

Gökhöyük, located in the Seydişehir district of Konya province, is believed to have a settlement dating back to the 7th...

Roman statue of a woman found in the ancient city of Blaundos in western Türkiye

September 23, 2024

September 23, 2024

A Roman statue of a woman was found during excavations in the ancient city of Blaundos, located within the borders...

Türkiye’s highest waterfall ‘Tortum’

May 11, 2024

May 11, 2024

The natural wonder Tortum Waterfall, which is the highest waterfall in Türkiye, is located in Uzundere district of Erzurum province....

Visiting hours of some museums and archaeological sites in Türkiye extended

June 14, 2024

June 14, 2024

Visiting hours of some museums and archaeological sites in Türkiye, which attracted great interest from visitors during the summer season,...

Comments
Leave a Reply

Your email address will not be published. Required fields are marked *