November 23, 2024 The sun rises from Anatolia

Using Artificial Intelligence to Create a 3D Model of a Lost Temple Relief from a 134-Year-Old Photograph

Researchers have developed a neural network capable of taking a single 2D photo of a three-dimensional object and producing a digital reconstruction in three dimensions. This method has the potential to revolutionize digital preservation, especially for artifacts that are hidden, too delicate for traditional 3D modeling, or too fragile to be excavated.

In a way, scientists have created a 21st-century stereoscope. Last month, at the 32nd ACM Multimedia conference, the team presented their proof-of-concept.

A research team at Ritsumeikan University led by Professor Satoshi Tanaka along with Dr. Jiao Pan, from the University of Science and Technology Beijing, used a 134-year-old photograph from the Borobudur Temple in Indonesia to demonstrate the incredible work this neural network can perform.

The largest Buddhist temple in the world, Borobudur is covered in 2,672 relief panels. Built in the 9th century CE, it was eventually abandoned, only to be discovered centuries later by Dutch archeologists.

Image Credit: Pan et al. 2024

The relief, found on the ground level of the famed Borobudur Temple a UNESCO World Heritage site, depicts a group of people in traditional attire set against a backdrop of trees and ancient architecture. It was only known by a black-and-white photo that was taken in the 19th century while the relief was exposed during reconstruction work. It was then covered over by reinforcement walls.

The recent team’s neural network managed to reconstruct one of those now-hidden reliefs using an old black-and-white photo from 134 years ago.

A depth map of the temple relief. Image Credit:: Pan et al. 2024

Although earlier reconstructions had been attempted, they were unable to capture the finer details of the reliefs. These three-dimensional reliefs contain detail from the carvings closest to the viewer and farthest from the viewer, and prior reconstruction attempts flattened out the details at these varying depths, resulting in the loss of those details due to the compression of depth values. Based on the computed curvature changes in the 3D space, the team created a map of the lost characteristics, which they called “soft edges.”

“Our multi-task neural network successfully reconstructed these hidden sections of Borobudur’s ground-level reliefs from surviving old photographs. Through computer visualization and virtual reality, our research now allows virtual exploration of these unseen treasures,” says Prof. Tanaka.

A soft-edge map (left) and semantic map (right) of the 2d relief image Credit: Pan et al. 2024

By enhancing the depth estimation, particularly around soft edges, they were able to produce images that more accurately represent the original reliefs. The technique is a breakthrough, as 3D scanning and photogrammetry can only record reliefs in their current state, whereas 3D digital restoration returns us to the original.
“Our technology holds vast potential for preserving and sharing cultural heritage,” shares Prof. Tanaka. “It opens new opportunities not only for archeologists but also for immersive virtual experiences through VR and metaverse technologies, preserving global heritage for future generations.”

DOI: 10.1145/3664647.3681612

Ritsumeikan University

Cover Image Credit: Terrace on the temple of Borobudur 1913. Wikipedia Commons

Banner
Related Articles

The mosaic of the Trojan War hero ‘Aeneas,’ with no parallel in the world, has been uncovered

August 31, 2023

August 31, 2023

During the excavation of the foundation of a construction site in the Kadirli district of Osmaniye, the mosaic of the...

Artifacts reflecting Egyptian influence found in the ancient city of Smyrna

May 25, 2024

May 25, 2024

Artifacts reflecting Egyptian influence were found during excavations in the ancient city of Smyrna, which has one of the largest...

8,200 artifacts from the Paleolithic period were discovered on a university campus in Turkey

January 2, 2024

January 2, 2024

Experts working in a pistachio orchard on the campus of Gaziantep University unearthed 8200 Paleolithic artifacts. The survey work in...

In front of the Frig altar, hearths and ovens dating back to the 7th century BC were found

October 9, 2024

October 9, 2024

In the excavations in front of the Phrygian rock altar within the Midas fortress attributed to King Midas of Phrygia,...

The jaw of a big cat featured in ancient shows has been found

October 2, 2023

October 2, 2023

The jaw of a big cat, thought to have been used in shows held at the theater in the Ancient...

Sarcophagus found during electricity cable renewal work in Hatay

March 29, 2024

March 29, 2024

A sarcophagus was found in Hatay, which was destroyed by a major earthquake in February last year, during the renewal...

The 2800-year-old Hittite goddess figurine found in the Valley of Levent

November 13, 2023

November 13, 2023

A Hittite goddess figurine from the eighth century can be found in the Levent Valley, which was created by a...

A rare 3,300-year-old bronze helmet from the Hittite Empire is on display at the Çorum Archaeology Museum

March 17, 2024

March 17, 2024

The 3,300-year-old bronze helmet unearthed during the excavations carried out in 2002 at the ruins of Şapinuva, one of the...

Painted hieroglyphs found in Hattusa Yerkapı tunnel opens a new page in the Hittite world

April 29, 2024

April 29, 2024

Prof. Dr. Andreas Schachner said that the painted hieroglyphs discovered in the Yerkapı tunnel in Hattusa, the capital of the...

2700-year-old children’s cemetery discovered in Tenedos Ancient City

March 2, 2024

March 2, 2024

A 2700-year-old children’s cemetery was discovered during the ongoing excavations in the ancient city of Tenedos under the direction of...

4000-year-old ceramic seal discovered at Tavşanlı mound, known as the “heart of Kütahya”

August 17, 2024

August 17, 2024

A 4000-year-old ceramic seal was discovered in Tavşanlı mound, also known as the “Heart of Kütahya” because it resembles the...

A 1000-year-old Seljuk rug is being exhibited at the Sivas Museum

March 15, 2024

March 15, 2024

A special section has been created at the Sivas Atatürk Congress Museum, where 62 historical rugs are being exhibited. Among...

Call from the Ministry of Culture to the Pergamon Museum: “The Temple of Zeus must return to its homeland”

October 18, 2023

October 18, 2023

The Pergamon Museum in Germany, which houses one of the most visited artifacts, the Temple of Zeus, taken from Türkiye,...

Roman artifacts discovered during a drilling for a housing complex construction

March 9, 2024

March 9, 2024

Gold earrings, rings, tear bottles and lamps dating back to the Roman period were discovered during a drilling for a...

Archaeologists found 3,500-year-old grape seeds

September 12, 2023

September 12, 2023

In the Aşağıseyit Mound located in the Çal district of Denizli, archaeologists uncovered a 3,500-year-old grape seed. The most surprising...

Comments
Leave a Reply

Your email address will not be published. Required fields are marked *