Decentralized Face Identification with Hierarchical Navigable Small World on Blockchain

Abstract

Abstract This paper presents a novel method for decentralized storage in deep-learning-based face recognition systems using the Hierarchical Navigable Small World (HNSW) algorithm. The proposed solution utilizes Ethereum smart contracts, which acts as highly available data storage systems for storing identifiable data for authorized personnel. In addition, the solution is integrated with a centralized vector database that is in charge of vector indexing, searching and associating face embeddings to an identity on the Ethereum blockchain with anonymous hashes. Vector indexing and search processes involve different machine learning algorithms that enable computations to be carried out in a reasonable time with good matching accuracy. Specifically, we compared different approaches and selected the HNSW algorithm. Accordingly, we successfully implemented a prototype of a reliable and privacy-focused decentralized face identification system for areas under government surveillance, such as customs inspection sites. In our measurements, the system could handle 20,000 face vectors easily with high matching accuracy, and the performance could be further improved using more powerful hardware. Finally, we also propose additional methods to further scale up the system to handle millions of face vectors.