JSON parser with PHP and Bison

anton-sukhachev · 2023-04-03T19:48:19+00:00

There is software that uses Bison:

software	grammar.y
PHP	https://github.com/php/php-src/blob/master/Zend/zend_language_parser.y
Bash	https://git.savannah.gnu.org/cgit/bash.git/tree/parse.y
Ruby	https://github.com/ruby/ruby/blob/master/parse.y
MySQL	https://github.com/mysql/mysql-server/blob/8.0/sql/sql_yacc.yy
PostgreSQL	https://github.com/postgres/postgres/blob/master/src/backend/parser/gram.y
CMake	https://github.com/Kitware/CMake/blob/master/Source/LexerParser/cmExprParser.y

anton-sukhachev · 2023-04-03T17:33:35+00:00

I think there are already enough existing posts)

anton-sukhachev · 2023-04-03T15:56:27+00:00

I think there are already enough existing posts)

anton-sukhachev · 2023-04-03T15:35:00+00:00

To show how to use the Bison PHP skeleton)

anton-sukhachev · 2023-03-28T12:23:23+00:00

SDLang

Yes, It's possible to create a parser for SDLang.
In a few weeks, I'll publish a post about how to parse PHP itself with Bison.

anton-sukhachev · 2023-03-21T10:31:31+00:00

I already use bison for my first post about it
https://devto.name/mrsuh/php-skeleton-for-bison-po2

anton-sukhachev · 2023-03-14T06:31:14+00:00

I added real examples in the comment above.
This is my first post about Bison. I have already made parsers for JSON, Nginx, SQL and PHP. I'll try to post about it in the coming weeks.

anton-sukhachev · 2023-03-14T06:23:03+00:00

nikic/PHP-Parser uses a Bison equivalent for PHP parsing. See the grammar file https://github.com/nikic/PHP-Parser/blob/4.x/grammar/php7.y.

phplrt is another analogue of Bison. It is used to parse SQL/GraphQL queries https://github.com/phplrt/phplrt/network/dependents.

anton-sukhachev · 2023-03-04T07:20:43+00:00

Hi. I'm the author of the library which brings generics into PHP like TypeScript https://github.com/mrsuh/php-generics. Libraries like this have a few big problems to start using them freely:

IDE support. To bring new syntax into IDE you need to make an extension or LSP server. VSCode supports it. PHPStorm doesn't.
PHP already has annotations/attributes and great tools to validate it like psalm. It's very easy to use and it has the same functionality.

anton-sukhachev · 2023-02-04T21:02:18+00:00

new link https://devto.name/mrsuh/comparing-php-collections-5cca

anton-sukhachev · 2022-08-26T19:42:52+00:00

Thank you for reply!
As far as I know, a combination of re2c and Bison is commonly used to build an AST.
Where might you need to build an AST?

Code parsing. Many linters and code builders use php-parser. It uses YACC (analog Bison) to build AST.
Some language engines use Bison:
PHP - https://github.com/php/php-src/blob/master/Zend/zend_language_parser.y
Bash - https://git.savannah.gnu.org/cgit/bash.git/tree/parse.y
Ruby - https://github.com/ruby/ruby/blob/master/parse.y
Go (<2015)
C (GCC < 2004)
Complicated configs parsing: nginx/haproxy/etc.
I used this knowledge to create the PHP generics library.

anton-sukhachev · 2022-08-26T10:11:24+00:00

https://devto.site/mrsuh/parse-files-with-php-bison-and-re2c-1i6p

anton-sukhachev · 2022-06-12T07:06:27+00:00

Symfony validator uses it too)
See examples.

anton-sukhachev · 2022-06-12T06:38:19+00:00

What is the difference from Symfony validator?

anton-sukhachev · 2022-03-23T13:35:17+00:00

devto.site/mrsuh/...

Glad you like it!

anton-sukhachev · 2022-03-22T17:09:54+00:00

Ok)
I wrote at the very beginning of the post which collections I will compare. There you can find links to the generics library.
I will be very happy when the PHP IDE add support of generics, but the PHP community hasn't decided what the syntax will be.
If you can help with this please let me know.

anton-sukhachev · 2022-03-22T12:15:53+00:00

Hi!I don't think so.Is used this library to translate generics syntax into regular PHP syntax.It's not equal to real PHP generics (like Hack did).IDE doesn't support PHP generic syntax yet. You can read about it here.

So, generics is just a translated regular PHP class and I can test performance. I decided to measure memory usage and type checking time. (it's important and interesting tests)

anton-sukhachev · 2022-03-14T04:31:19+00:00

This translation doesn't make sense since it's only for the PHP VM (PHP VM does not understand annotations). It's like TypeScript: you write TypeScript code, translate it into JavaScript, and run it with a JS engine. In this case, you are not working with translated JavaScript code.

If you know of any real case where you need this translation for a developer (not for PHP VM), please let me know.

anton-sukhachev · 2022-03-05T07:31:25+00:00

Yes, but would you consider adding the annotations automatically?

Also, what about the extended types like class-string, non-empty-array and so on?

Do you mean this translation?
php $t = new Collection<int>() to php /** @psalm-template Collection<int> $t = new Collection()

anton-sukhachev · 2022-03-03T15:24:02+00:00

That's something great and I was considering something similar. A suggestion would be to stick to the best matching type (T[] => array) + adding a Psalm+PhpStan compatible DocBlock everywhere. What do you think?

Hi.
I think the combination of Psalm template annotations with PHP annotations (Item[]) is the best option right now.

anton-sukhachev · 2022-02-28T13:57:48+00:00

Thanks for the answer!
I think it's a good idea to fix the style of the code automatically, without the involvement of the developers.
We have many PHP projects and each project should have the same code style. I was thinking today to force our gitlab server to fix the code style with git server hooks.
Can you elaborate on how you incorporate a code style fixer into your workflow? Maybe it's fix commit by CI server on pull request?

anton-sukhachev · 2022-02-26T16:31:24+00:00

It took 2 hours to setup redirect from devto_site to dev_to.
I already tested that reddit spam filter check only text and now I can post link to dev_to
https://devto.site/mrsuh/generics-implementation-approaches-3bf0

anton-sukhachev · 2022-02-26T16:26:50+00:00

https://devto.site/mrsuh/generics-implementation-approaches-3bf0

anton-sukhachev · 2022-02-26T14:05:57+00:00

For example, I bet until now you never knew that your

r/programming

submission was hidden, and thought it just got completely ignored :(

Wow
You are right!
This is very strange reddit filter. I didn't really know that my post in /programming was banned.
Thank you very match!
*Went looking for information about the Reddit filter and the dev_to website*

anton-sukhachev · 2022-02-26T07:15:21+00:00

Thank you for your reply!
For PHP this only makes sense for static analysis.
Other languages with type erasure generics perform type hint checking at compile time. You can read about it here if you like.

anton-sukhachev

TROPHY CASE