Tunnel Parsing with the Token’s Lexeme-Reference-Cited by-同舟云学术

Tunnel Parsing with the Token’s Lexeme

Published:2022-06-01 Issue:2 Volume:22 Page:125-144
ISSN:1314-4081
Container-title:Cybernetics and Information Technologies
language:en
Short-container-title:

Author:

Handzhiyski Nikolay¹²,Somova Elena¹

Affiliation:

1. University of Plovdiv “Paisii Hilendarski” , 24 Tzar Assen Str ., Plovdiv , Bulgaria

2. ExperaSoft UG (haftungsbeschraenkt) , 10 Goldasse Str., Offenburg 77652 , Germany

Abstract

Abstract The article describes a string recognition approach, engraved in the parsers generated by Tunnel Grammar Studio that use the tunnel parsing algorithm, of how a lexer and a parser can operate on the input during its recognition. Proposed is an addition of the augmented Backus-Naur form syntax that enables the formal language to be expressed with a parser grammar and optionally with an additional lexer grammar. The tokens outputted from the lexer are matched to the phrases in the parser grammar by their name and optionally by their lexeme, case sensitively or insensitively.

Publisher

Walter de Gruyter GmbH

Subject

General Computer Science

Link

https://www.sciendo.com/pdf/10.2478/cait-2022-0021

Reference44 articles.

1. 1. Handzhiyski, N., E. Somova. A Parsing Machine Architecture Encapsulating Different Parsing Approaches. – International Journal on Information Technologies and Security (IJITS), Vol. 13, 2021, No 3, pp. 27-38.

2. 2. Unicode Standard. https://www.unicode.org/

3. 3. Deremer, F. L. Practical Translators for LR(K) Languages. Massachusetts Institute of Technology, USA, 1969.

4. 4. Aho, A., J. Ullman. The Theory of Parsing, Translation, and Compiling. Prentice-Hall, USA, 1972.

5. 5. Chomsky, N. Three Models for the Description of Language. – IRE Transactions on Information Theory, Vol. 2, 1956, No 3, pp. 113-124.10.1109/TIT.1956.1056813

Cited by 2 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. SCLang: Graphical Domain-Specific Modeling Language for Stream Cipher;Cybernetics and Information Technologies;2023-06-01

2. Tunnel Parsing with Ambiguous Grammars;Cybernetics and Information Technologies;2023-06-01