Natural-Scientific and Philosophical Aspects of the Unity of Painting and Music: a View Through the Prism of Artificial Intelligence

Abstract

This article discusses a philosophical description of the unity of painting and music through the prism of the natural-science phenomenon of the generation of phonon oscillations by the surface of a painting surface. A method is proposed for using artificial intelligence in the automated detection of phonon oscillations, which consists in a matrix recording of dynamic two-dimensional light scattering, convolution of the matrix into topological indices, and sonification of the change in indices over time. We have developed the new method for controlling surface phonon oscillations based on diffuse reflection kinetics. The specialized software “Vidan” records the kinetics of changes with 10 topological indices, which reflects the propagation of a phonon wave on the surface during capture and inelastic scattering of secondary cosmic rays [3]. To control the state of the surface, either the fingerprint of 10 topological descriptors is used (this analysis is automated through the “Atrium” remote software), or a spectral analysis of the distribution of descriptor values in time is carried out. In art the method was used for generation the "digital" passport (including the topological descriptors) of new paintings in order to control the appearance of copies. The algorithm for converting phonon oscillations of a painting leads to the generation of a unique melody. In this case, the main part of the creative activity belongs not to the composer, but to artificial intelligence, which generates a melody based on the chemical composition of the paint material of the picture and the method of applying the painting layer (that is, the artist's "hands"). The material heritage of the painter's work continues to generate new works of art “offline”, while artificial intelligence acts only as a way of detecting and sonification of the natural vibrations of the surface of the picture. It is shown that each painting generates its own unique melody. This uniqueness made it possible to propose an original system for checking the authenticity of works of art: for new works of artists. A cloud-based automated control system "Atrium" has been implemented, which allows tracking any logistical movements of the picture and the change of owner according to the topological musical digital passport of the picture generated by its surface.