EM starts from here
Requirements
During data collection process, you can draw an Extended Matrix using any kind of support (digital or not).
However, in order to connect EM with Blender, a specific digital format of the EM graph (.graphml format) is required. As a response to this need, it is recommended to download yED, a free (non-open source) software useful for producing digital graph.
EM is fully developed for Blender, therefore it is required to install Blender as well to establish a connection between EM and 3D models.
EM stable release: v. 1.4 (15/10/2024)
EM a in few steps:
lay the foundation for your reconstructive work in an orderly manner with the EM list of sources: it consists of a simple (and useful) table where EM users can list and easily verify all the documents used within the EM, with all their linked data (name of the source, authors, location, notes etc.. );
draw EM within yED using EM palette. This palette contains all needed nodes (US, USV/s, USV/n etc...);
install EM tools inside Blender to connect EM with the 3D scene (i.e., to check EM data within the 3D software while modelling);
create your models (Proxy models and Representation models) within Blender with the help of the EM3Dtool addon;
An official repository of the EM formal language with the present and all the past releases is available here
Change log
EM 1.4 formal language (announcement):
Release Date: 15/10/2024
Version 1.4 of the Extended Matrix formal language introduces new features aimed at enhancing the ability to describe and formalize surface degradation and transformations over time. Below are the key updates included in this release:
[expand section to read more..]
1. Addition of the Transformation Stratigraphic Unit (TSU) Node
Description: The new TSU node has been introduced to formalize and represent surface degradation phenomena. It enables the description of changes in a stratigraphic unit or physical object, such as walls or other surfaces, affected by long-term degradation processes.
Usage: The TSU node provides a conceptual and visual representation of surface changes over time, facilitating the analysis and interpretation of surfaces that have undergone structural or aesthetic alterations, such as erosion, discoloration, or fragmentation.
Benefits: With the TSU node, users can integrate detailed information about the condition of surfaces, connecting these changes to the broader timeline of an archaeological site or architectural structure.
2. Introduction of the Dotted Connector
Description: The new dotted connector has been added to link multiple instances of the same stratigraphic unit that has transformed or moved over time. This connector enables users to establish a relationship between different versions of the same element, describing how it evolved or was relocated.
Example of Use: A wall with stratigraphic unit US100 found in a collapsed state during an excavation can be linked via the dotted connector to US100B, representing the same wall relocated to a different position as part of an anastylosis. This preserves the semantic connection between the two instances of the object while acknowledging the change in position or condition over time.
Application: Ideal for representing structural elements or artifacts that have been altered, moved, or reconstructed while maintaining a unique reference to their historical origin.
3. General Improvements
Optimization of temporal queries to incorporate degradation data through TSU nodes.
Enhanced rendering of dotted connections for improved visualization in knowledge graphs.
Compatibility: Version 1.4 is fully compatible with previous versions of Extended Matrix and existing APIs.
For further details on implementation or technical inquiries, please refer to the updated documentation or contact technical support.
EMtools (Blender addon) 1.4
New Features:
XLSX Reader: Added functionality to import source files in .xlsx format for easier data handling and integration.
JSON Exporter for Aton & EMviq: Extended support for JSON serialization, enabling the export of knowledge graphs for Aton and specifically for EMviq workflows.
External Libraries Installation: Introduced new systems to easily install and manage external libraries within the tool.
Aton Integration: Added the ability to launch Aton directly from Blender for streamlined workflows.
Statistics & Geometry Tools: New tools for calculating statistics, volumes, and dimensions, including surface areas of wall structures based on selected proxy models.
Automatic Property Numbering: Support for automatic numbering of properties within the Extended Matrix.
Collection Exporter for EMviq: Added functionality to export collections directly to EMviq for enhanced data management.
Improvements:
Code Cleanup: General code optimization and performance improvements to enhance overall tool stability and efficiency.
Bug Fixes: Resolved various issues and added tools for opening node-related resources, such as images, directly from the operating system.
Extended Functionality:
Transformation Stratigraphic Unit (TSU): Version 1.4 introduces support for TSU, allowing for detailed characterization of degradation surfaces.
These updates make the Extended Matrix Tool even more powerful and adaptable to advanced workflows, enhancing integration with Aton and EMviq.
EMF 1.3 (announcement) :
New Documentary (Stratigraphic) Unit node (orange colour) to express elements with existence is directly referenced by a source, for instance, a drawing, a writing source or a photo. See details in the technical documentation.
Removed distinction between “epoch“ and its reconstruction “epoch rec”: now all the information regarding an epoch is stored in the same row.
Standardized source list to organize with consistency the sources in an excel file during data collection in the library or on the field.
New palette including coloured nodes and the new USD node to improve the visual clarity of the matrices.
The new version of EMtools includes:
full support of EM 1.3
a refactored export panel targeting Aton 3-based web apps (like EMviq) with tools to easily optimise models for web visualisation;
new button to turn off and turn on just reconstructive elements “per epoch” (according to the removal of the “epoch”-“epoch rec” duality)
an importer for SQLite databases (targeting several to extend alphanumeric information available within blender (building technique, etc..);
an importer for the official EM source list (.xlsx format) to enrich the standard information about the source (URLs, description, etc..) contained in the GraphML file.
The new version of EMviq includes:
full support of EM 1.3
representation of paradata nodes within the EMviq online experience
Added a first version of EMdb data structure file targeting several formalized data sheets in archaeology (Italian ministerial USM sheet, an experimental USV sheet) to be imported into Blender.
EM 1.2
New white series node to express series of existing elements (a series of bases of columns found in original position).
New continuity node to express the duration time span of a stratigraphic unit.
EMF 1.2:
Added a new palette including coloured nodes and the new USD node to improve the visual clarity of the matrices.
The new version of EMtools includes:
EMviq exporter to create a non-redundant folder tree including metadata, paradata, proxies, and representation models with a manager of exporting errors
EM 1.1
full support to 3D modelling:
Proxy models are simplified representations of the reconstruction through basic geometrical shapes (cylinders, boxes, spheres, etc.)
Representation models are focused on fine geometries, colour, and material simulations resulting in the final, aesthetic depiction of the reconstruction hypothesis.
Snapshots: a snapshot is a survey of a model collected at a precise moment in time (i.e. the photogrammetric survey of a Temple in 2014). The snapshots are a palimpsest of a context. In order to isolate the elements pertaining to a given epoch they are geometrically segmented and cleaned by posthumous portions.
EM workflow standardisation (data collection, analysis and outputs)
Guidelines for scientific publication of a re-construction hypothesis
Report of virtual activities that enables an intermediate output for non-technical users
Dossier Comparatif for the collection and organisation of the sources
New conventions in node connection (arches) to simplify and made clearer the visual representation of the EM have specific documentation (whitepapers, online wiki, etc.).
and much more...
Starting from this version, along every new EM, there is a EMF Extended Matrix Framework which includes tools and software to make the use of the Extended Matrix approach smoother and more effective.
EMF 1.1
EM Tools Blender addon
EMviq tool, designed and developed by Bruno Fanini, which provide a complete visualisation and interrogation context within the framework. It is a collaborative, cloud based tool which connects the 3D models (reconstructive and snapshots) with the reconstruction hypothesis (EM). It can be used as a convenient test for the formal correctness of the EM.
EM 1.0
formalization of the core EM language with the nodes and the relations
formalization of the proxies (created, named, and coloured manually by the user in 3D software)
formalization of the Virtual activities
EMF 1.0
first yed palette for the EM1.0
Experimental features
If you want to experience some experimental features you need to download (see boxes below):
EM palette 1.5 dev 1. This version contains some new nodes that we are going to include on the next release of the EM palette.
EM 3D Tools 1.5 dev 1. This release gives you the possibility to test the connection between the latest EM nodes (still under development) and the 3D scene within Blender.
News from this development release:
Moving all the interaction with the Knowledge Graph in a dedicated library: s3Dgraphy scientific 3D graphs for stratigraphy
Refactoring of the GraphML parser
Adding Activity manager
Adding Multigraph management (aka Multi Topographic Units - multi UT)
Online sharing
The DHILab of the CNR-ISPC of Rome has developed a web-app (EMviq), based on the Aton framework, that allows you to:
share online your 3D reconstruction
freely explore your 3D scene
organize a virtual tour where you can virtually interact with visitors using 3D tools and your own voice
observe the realibility of your 3D model
and much more...
Aton is an Open Source Web3D/WebXR app which is suitable for enhancement and disclosure purposes.
EMviq, which inherits all the features of Aton, includes EM representation functionality and has been developed for scientific purposes.
In order to share online your 3D reconstructions you need to install both Aton 3.0 and EMviq (click on the buttons below and follow the instructions).
Other recommended tools
Hereafter is a list of software that have been developed to ease and improve some steps of the process:
3D Survey Collection (3DSC, doi:10.5281/zenodo.4459453) is an addon of Blender that allows you to edit your 3D data within the same 3D software. A beta version for developer is also available;
3DSC for Metashape is a simple and useful script that gives you the ability to rapidly import your 3D tiles within Metashape and apply them a texture;
uNveil (alpha, doi:10.5281/zenodo.591289) is a new add that allows you to create Digital Storytelling within Blender.
EM-compatible projects
Hereafter is a list of projects that have been connected to EM:
pyArchInit is a plugin for Qgis that allows to manage archaeological documentation from field work to virtual reconstruction. The connection with EM framework has been presented at ArcheoFoss 2021 (click here).