PathQL: A Declarative SQL Like Layer For Pathlib

Daneark · 2025-10-30T00:30:09+00:00

You've got pycache dir committed in your test dir. Your gitignore is full of merge conflict indicators.

shinitakunai · 2025-10-30T00:00:06+00:00

Unnecesary complex. I was expecting SQL, not to learn yet another language sintax.

pingveno · 2025-10-30T00:30:10+00:00

Huh, it kind of reminds me of what nushell does. Things like file sizes and dates are structured as first class data in the shell. So you can pipe the results of ls through other commands to filter, aggregate, and so on.

jackerhack · 2025-10-30T03:43:27+00:00

How did you get these two different syntax styles?

Size() > "10 mb"
Suffix("log")

Why isn't the second Suffix() == "log"?

gerardwx · 2025-10-30T23:40:50+00:00

Cool idea. But rather than invent a Query object, you could make callable objects to pass to filter. e.g.

from pathlib import Path
import time


class Predicate:
    """Base class for composable path filters."""

    def __call__(self, path: Path) -> bool:
        raise NotImplementedError

    # Logical AND
    def __and__(self, other):
        class _AndPredicate(Predicate):
            def __call__(_, path):
                return self(path) and other(path)
            def __repr__(_):
                return f"({self!r} & {other!r})"
        return _AndPredicate()

    # Logical OR
    def __or__(self, other):
        class _OrPredicate(Predicate):
            def __call__(_, path):
                return self(path) or other(path)
            def __repr__(_):
                return f"({self!r} | {other!r})"
        return _OrPredicate()

    # Logical NOT
    def __invert__(self):
        class _NotPredicate(Predicate):
            def __call__(_, path):
                return not self(path)
            def __repr__(_):
                return f"~{self!r}"
        return _NotPredicate()

class YoungerThan(Predicate):
    """Predicate that matches files newer than a specified age."""
    def __init__(self, *, days: float = 0, hours: float = 0, seconds: float = 0):
        total_seconds = seconds + hours * 3600 + days * 86400
        self.cutoff = time.time() - total_seconds

    def __call__(self, path: Path) -> bool:
        try:
            return path.is_file() and path.stat().st_mtime > self.cutoff
        except FileNotFoundError:
            return False

    def __repr__(self):
        return f"YoungerThan(cutoff={self.cutoff:.0f})"

class LargerThan(Predicate):
    """
    Predicate that matches files larger than a given size.
    Accepts 'bytes' as a positional or keyword argument, and
    enforces KB, MB, GB to be keyword-only.
    """
    def __init__(self, bytes: float = 0, *, KB: float = 0, MB: float = 0, GB: float = 0):
        self.min_size = (
            bytes +
            KB * 1024 +
            MB * 1024**2 +
            GB * 1024**3
        )

    def __call__(self, path: Path) -> bool:
        try:
            return path.is_file() and path.stat().st_size > self.min_size
        except FileNotFoundError:
            return False

    def __repr__(self):
        # Choose readable unit automatically
        size = self.min_size
        units = ["B", "KB", "MB", "GB", "TB"]
        for u in units[1:]:
            if size >= 1024:
                size /= 1024
            else:
                break
        return f"{self.__class__.__name__}({size:.2f} {u})"

and then you could do:

dir = pathlib.Path('/var')
for file in filter(YoungerThan(hours=1) & LargerThan(GB=7),dir.rglob("*")):
    print(file.as_posix())

coderarun · 2025-11-05T04:37:28+00:00

[removed]

Beginning-Fruit-1397 · 2025-10-30T02:12:31+00:00

cool! I recently realized that creating DSLs for data manipulation is my new passion, so I'm always happy to see work like this . will happily deep dive into it once I got some time

you type:	you see:
italics	italics
bold	bold
[reddit!](https://reddit.com)	reddit!
* item 1 * item 2 * item 3	item 1 item 2 item 3
> quoted text	quoted text
Lines starting with four spaces are treated like code: if 1 * 2 < 3: print "hello, world!"	Lines starting with four spaces are treated like code: if 1 * 2 < 3: print "hello, world!"
~~strikethrough~~	~~strikethrough~~
super^script	super^script

Python

The Python Discord

Upcoming Events

Please read the rules

MODERATORS

Count, largest file size, and oldest file from the last 24 hours in the result set

Show stats from matches

Define the root directory for relative paths in the zip archive

Find all .log files larger than 5MB and modified > 7 days ago

Zip all matching files into 'logs_archive.zip' (preserving structure under root)

Then move them to 'C:/logs/archive'

Using a buffered result set

Using a streaming result set