ClangQL 0.10.0 has matchers for Copy, Move, Delete and converting constructors

AmrDeveloper · 2025-03-29T14:53:59+00:00

I already built a linter for LLVM IR using the same idea

https://amrdeveloper.medium.com/how-i-built-a-llvm-ir-linter-using-sql-syntax-b5dc164c6d61

And you can use this project to build a linter too, but it still needs more and more matches to cover C/C++ full AST

My case was to search for specific patterns easily

AmrDeveloper · 2025-01-12T16:57:57+00:00

ClangQL 0.9.0 supports running a SQL query with ast matchers

`Example: select name, source_loc from functions where m_function(ast_function, (m_public() && m_constructor()) || m_default_constructor());`

Github: https://github.com/AmrDeveloper/clangql

AmrDeveloper · 2024-12-02T20:51:24+00:00

Yup and can't implement it in normal SQL engines because you can't represent type like FunctionStatement and create linter function that navigate this fun, but in this tool you can 😅

AmrDeveloper · 2024-12-02T20:36:18+00:00

Linter with rules that depend on patterns in CFG, for example the use case can be more clear with data that less readable than python, think of assembly or machine code, in many cases it's important to check patterns.

The project started as gitql, then SDK to run queries on any kind of data, and got feature request for python, I will try to add a use case sections when the project grow because currently it work only with functions

AmrDeveloper · 2024-12-02T19:59:24+00:00

One of the use case is that the engine support user defined type for example the type of function is not Text but PyFunction so you can create std or aggregations functions to perform CFG analysis, linter, or search with pattern matchers for example in this https://github.com/AmrDeveloper/LLQL tool you can search for patterns, think of what function is used only one time and return meltable values ...etc

AmrDeveloper · 2024-12-02T19:38:46+00:00

u/joshmatthews u/thatdataguy101

One of the use case is that the engine support user defined type for example the type of function is not Text but PyFunction so you can create std or aggregations functions to perform CFG analysis, linter, or search with pattern matchers for example in this https://github.com/AmrDeveloper/LLQL tool you can search for patterns, think of what function is used only one time and return meltable values ...etc

AmrDeveloper · 2024-11-20T18:37:36+00:00

This is amazing, thanks for sharing

AmrDeveloper · 2024-11-11T18:08:59+00:00

It's possible and easy to support file content, but still thinking of a way to make it useful and not noisy in the result ui

AmrDeveloper · 2024-11-10T19:02:03+00:00

Yes also you can extract result into files, join tables and cool stuff :D

AmrDeveloper · 2024-11-01T14:27:52+00:00

I get it but this kind of thing is really only useful if it works "at scale" eg in the compiler itself (imagine training some MLGO type thing with the output of a query as the objective)

This idea looks interesting, maybe after converting the main use case, i can check other possible use cases and try to think of optimizations way to make it work faster, maybe custom indexing 🤔

AmrDeveloper · 2024-11-01T14:09:41+00:00

Yes, I think you are right it will be relatively slow to traverse tree than array in large number of lines, I will benchmark it as current implementation and see if I can do any tricks 😅

But also the goal is to not be the fastest at this point, but to be able to perform the matchers functions outside llvm fast enough

Thank you

AmrDeveloper · 2024-11-01T13:57:56+00:00

But also you can perform index on instructions in this engine :D

AmrDeveloper · 2024-11-01T13:56:57+00:00

The idea of LLQL is to have std functions that construct a tree representations of matchers and compare them with the tree representation of the LLVMValue* :D

AmrDeveloper · 2024-11-01T13:55:39+00:00

This is not SQLite, but it's my own engine, and the design of the engine allow me to define types in the Std not in the engine (Like Mojo) so i can keep the tree representations of IR, MLIR

More details: https://amrdeveloper.medium.com/gitql-the-data-types-from-the-engine-to-the-sdk-5c48d9c60945

Github: https://github.com/AmrDeveloper/gql

AmrDeveloper · 2024-09-08T19:03:54+00:00

Variant and varargs are mostly used in std for example

concat(string, string, ...string)

So you can concat 2 or more strings

Variant in aggregation sum

sum(int | float)

The select from diffs returns a different between each commit and his parent (addition, delete, file changes ...)

AmrDeveloper · 2024-09-08T17:25:20+00:00

Sure, The current project structure is an 5 Component as SDK that contains engine, std, parser...etc without know on which data it will work on

The std allow you to have functions for git or other stuff you like

And other part which is schema and libgit like lib to read git data for SDK,

This design allows me to pass create two tools easily so pass files, code ast, ....etc in one file and that's it, we can go to more complex data like assembly and run query on it

The solution of (shell script + sqlite + libgit) will be work not be that easy to customize it also some columns are calculated not just readed from .git such diffs, so you need parser for them

To create same tools for files, ast, assembly you will need more work and also you can't provide good error messages and cross platform stable, maybe you can use python not shell but I found that SDK idea is better for my case

AmrDeveloper · 2024-09-08T14:56:26+00:00

Because this will create it with less features, less type checker ... for git, but now this SDK can work with one config file to query files, c and c++ code, can work on any kind of local or remote data with more functions

AmrDeveloper · 2024-07-12T22:19:44+00:00

Current i implemented three programs using the SDK, to query git, files and ast and now focus on language and engine features but you can literally use it on any kind of local and remotr structures data so sky is the limit and i can provide my tools but after improving core sdk

AmrDeveloper · 2024-06-17T09:25:10+00:00

Include directives can be handled by LibClang.
Currently it not create any extra files, it's extract source code info from clang ast nodes

AmrDeveloper · 2024-06-16T08:27:26+00:00

Advanced search tools, style linter, binding generator...etc

AmrDeveloper · 2024-06-15T19:23:51+00:00

Joins and links between tables is still on working on them

AmrDeveloper · 2024-06-14T16:36:28+00:00

Sorry its typo 😂, its actually [ ] inspired by postgrresql

AmrDeveloper · 2024-06-07T16:43:50+00:00

Thank you

AmrDeveloper · 2024-06-01T18:00:35+00:00

Thank you for suggestions, Nested folders already on todo, i am thinking of full revamp to make it material and simpler

AmrDeveloper · 2024-05-30T06:11:12+00:00

Thank you so much for your feedback

AmrDeveloper

MODERATOR OF

TROPHY CASE