The Venice Time Machine project officially begins with an initial agreement signed on February 23, 2013 between Ecole Polytechnique Fédérale de Lausanne (EPFL) and Ca ’Foscari University. For this signing, the Italian Minister of Education and Research, Francesco Profumo, as well as the Swiss Secretary of State for Education, Research and Innovation, Mauro Dell’Ambrogio, make the trip to Venice, thus highlighting the collaboration within the context of good Switzerland-Italy relations.
A joint training program between EPFL and Ca’Foscari University is set up, taking the form of regular autumn schools: joint activity weeks were organized by the partners. The objective of these training courses, attended not only by students from EPFL and Ca’Foscari University but also young researchers from several other European and American institutions, is to develop an interdisciplinary training around archival material and new technologies.
The State Archives, Ca’Foscari University and EPFL sign a first formal collaboration document framing a joint program of actions for the future. The aim of the project is to transform the documentary heritage of archives into an online information system which is available online for the community of researchers and specialists, but also for the general public. The agreement specifies that “the digitization of ancient documents is an essential step for the conservation and enhancement of cultural heritage, two of the fundamental missions of archives.” And that “digital images .. make research possible worldwide allowing thus the creation of ambitious international projects.” The text continues: “For these projects to be carried out, it is important to create a freely accessible database of images of documents associated with related instruments and records of archival descriptions.” Finally, to avoid any ambiguity, the agreement specifies: “In addition to viewing the images, it will be possible to download them in accordance with standards of the Code of Cultural Property and Landscape“. The objective of the project is as “helping the Venice State Archives to make rapid progress in the digitization of the documents it stores and in making these documents available to the international research community.” It is for this reason that the images will be “distributed globally with an open license.”
The EPFL provides the scanners, servers, computers and all the necessary equipment for the creation of a first digitization space to be installed within the State Archives of Venice. A pre-study phase in close collaboration with the archivists takes place from June to September 2014 in order to test the performance of the digitization chain, primarily in terms of speed in accordance with the categories of documents considered. On the basis of this preliminary study, the choice of series and the configuration of the teams would be established. On June 2014, the official inauguration of the digitization center takes place in the presence of Patrick Aebischer (President of EPFL), Carlo Carraro (Rector of Ca’Foscari), Raffaele Santoro (Director of ASVe) and Thierry Lombard (main sponsor of the project).
EPFL hires and trains five Italian specialists for the operations of the scanners and the annotation of digitized documents, as well as a qualified team leader with a paleography and archival background (trained by the school of archival and internal paleography in the Archive): Fabio Bortoluzzi. Among this team, one of the archivists will join the State Archives of Venice a few years later, and Fabio Bortoluzzi himself will go on to become director of the Vicenza State Archives.
The protocol for digitization, metadation and annotation is established by the team leader and the archivists of the Venice State Archives on the basis of the results of 2014’s pre-study phase. An estimate of the number of hours is produced for the digitization and description of various documents series. On the basis of these estimates, it is decided to carry out a basic description of the registers and to concentrate efforts on searches facilitating the automatic extraction of information. In July 2015, a first version of an annotation software is deployed within the State Archives.
2015 is also a period of intensification of the collaboration between the EPFL teams and the other Venetian institutions. Several parallel projects are launched. The “Garzoni” project – a partnership between EPFL, the University of Lille (Valentina Sapienza) and the University of Rouen (Anna Bellavitis), funded by the Swiss National Fund and The French National Agency for Research – aims to build an information system in order to conduct historical research on the question of learning from the perspectives of the economy, family, gender, art and architecture. It focuses on the “Gustizia Vecchia” collections, which had already been digitized by the University of Lille in partnership with the State Archives, and is coordinated by Maud Ehrmann for EPFL, involving a dozen other researchers.
A second project funded by the Swiss National Science Foundation, Linked Books, begins on September 1, 2015. The project explores the “history of history” of Venice using new algorithmic approaches, based on networks of citations and full-text analyzes of publications. The project is coordinated by Giovanni Colavizza and Matteo Romanello and concerns a corpus of more than 2,000 monographs and 5,000 newspaper articles published over the past 200 years and dealing with all aspects of Venetian history. For this project, several specific contracts are established to supervise the digitization of the collections of secondary sources necessary for the project, notably with the Marciana Library, the Istituto Veneto and the Ca’ Foscari University Library.
Finally, also in 2015, EPFL and the Giorgio Cini Foundation signed an agreement for the launch of the Replica project, coordinated by Isabella di Lenardo which aims to digitize the foundation’s photo library (one million images) and to build an engine for research enabling the search for morphological patterns. The agreement specifies that the digital photo library and the search engine will be open access. A new type of scanner is developed by Adam Lowe’s team at Factum Arte. It is designed as a rotary table that moves continuously during a scanning session, simultaneously photographing both sides of documents on a page and automatically uploading the images to a computer. The project will also give rise to a doctoral thesis by Benoit Seguin who will propose a new way to train neural networks using deep learning to detect recurrences of patterns on media as diverse as drawings, paintings, engravings or photographs.
EPFL begins its participation in the READ project in January 2016 to accelerate progress in the handwriting recognition. Venice Time Machine is one of the large-scale demonstrators of the project.
On the EPFL campus in Lausanne, a new building designed by Kengo Kuma, Artlab, is inaugurated in November. A permanent exhibition on the Venice Time Machine is presented in the “Datasquare” pavilion. Director Raffaele Santoro is interviewed several times and his explanations are presented on the pavilion screens, along with other testimonials from historians and researchers working on the project.
In 2017, EPFL makes the problem of sharing images via the network more effective with the creation of a first version of the Time Machine Box. It is a server, installed at the location of scanning, that is to say directly at the archives, on which all the scanned documents and their metadata are hosted and easily accessible via the IIIF protocol, which defines international standards on image exchange. The Time Machine Box is not a simple storage space. It allows any research organization to perform an analysis on the images present to perform an analysis using document segmentation algorithms or handwriting recognition , presuming these are compatible with the IIIF standard.
In October of the same year, EPFL, Ca’ Foscari University and the State Archives of Venice and the Giorgio Cini Foundation, publish a joint press release which will give rise to several articles publicly announcing the first results of the project and of the digitization campaign, including: 190,000 digitizations of archival documents, 720,000 photographic documents, 3,000 books covering 200 years of Venetian historiography, making a total of more than 2 million digitized images. On this basis, 160,000 manual transcriptions of name, location and keywords were performed by archivists. A search engine using a handwriting recognition system based on these annotations is announced. To mark this occasion, Michele Bugliesi, the Rector of Ca’ Foscari University declares:
“The digitization of archival holdings opens up new avenues for the study and understanding of the history of the cultural evolution of past and contemporary civilizations. With this project, Venice is at the forefront of Europe, demonstrating the enormous potential that digital technologies offer for the enhancement of cultural heritage and their ability to develop research methods in the fields of history, art history and more generally for research in the humanities and socio-economic sciences.”
In June 2018, a joint research center established between the Cini Foundation, Factum Arte and the DHLAB of EPFL is inaugurated. The center is named ARCHiVe – Analysis and Recording of Cultural Heritage in Venice and is funded by the Helen Hamlyn Trust.
As planned, an automatic handwriting recognition system is developed from the annotated Venetian documents within the framework of the European READ project. The results obtained by researcher Sofia Ares Oliveira at EPFL are very encouraging: the recognition performance of this system exceeds the reading skills of an Italian person without archival training. The system is presented for the first time in Mexico City at the Digital Humanities 2018 conference. The same summer, a generic document segmentation system (dhSegment), initially developed to solve the segmentation problem of Replica project, is also made available open source. In just a few months, this free and open system will be used by dozens of archives around the world, including the National Archives in Paris.
The search engine, announced in 2017, combining text search, visual search and geo-historical navigation to allow efficient access to the sources of the Venice State Archive and the Cini Foundation, is unveiled to public during the Time Machine 2018 conference. Indeed, EPFL and Ca’ Foscari University become founding members of a project submitted to the European Commission for the establishment of a “European Time Machine”, along with 31 other European institutions. Thanks to the extraction methodologies and open technologies developed, the Venetian model can now be exported as a generic format to understand the past of European cities.
A large exhibition at the Venice Biennale of Architecture presents the project in the Padiglione Venezia and Venice Time Machine results are also features in a large exhibition at the Grand Palais in Paris.
The pan-European Horizon 2020 Time Machine Coordination and Support Action is funded by the European Commission. The number of supporting partners continues to grow and reaches more than 400 institutions, confronting Europe’s challenge to build an open database of information that has thus far been segmented into silos. The Venice Time Machine now becomes one among 20 others Local Time Machines.
EPFL wins the Parcels of Venice project to continue research on Computing methodology to extract information from cadastral sources.
EPFL publishes results based on newly collected and digitized daily death records, or necrologies, from the city’s Patriarchal Archives in the open-access Nature Research journal, Scientific Reports. The article uses data science techniques to analyze the spread of the bubonic plague, which is caused by the bacterium Yersinia pestis, in Venice between 1630 and 1631. The team observed that the deaths appeared to follow a novel pattern: a first peak in 1630 that reached over 400 deaths per day at its worst, followed by a less acute, but longer-lasting, peak in 1631. They note that this is the first description of such a “long tail of high mortality” in the literature on the subject.
The Time Machine Organisation is created as a non-profit organisation with headquarters in Vienna. It is supported by more 600 institutional members.
As part of the strategy to construct the prototype of a Mirror World for Venice, the 3D scanning of the Island of San Giorgio Maggiore is carried out by the Factum Foundation and EPFL team from 6 to 17 July 2020, using LiDAR scanning and terrestrial photogrammetry. An enormous quantity of data, 60,000 million points, is produced and analysed.
Meanwhile, more than 100 Local Time Machines initiatives are created throughout the world, following the logic of the Venice Time Machine initiative.
In February, some of Venice Time Machine models are presented at the Belvedere exhibition “Viva Venezia” in Vienna.