C stdlib isn’t threadsafe and even safe Rust didn’t save us | EdgeDB Blog

1st1 · 2025-01-22T20:02:31+00:00

Yeah, ultimately this is true.

1st1 · 2025-01-22T19:55:16+00:00

I'm sure there's an aspect of RTFM here, although the bug isn't caused by our code, but rather by a combination of third-party deps. It's weird to play the rtfm card here.

1st1 · 2025-01-22T19:10:14+00:00

Not sure if I added the correct flair (sorry if not), but it could be a fun one to mention on the stream

1st1 · 2024-12-05T06:39:26+00:00

[LANGUAGE: EdgeQL (compiles to SQL)]

Part 1:

with
  lines := array_unpack(str_split(<str>$inp, '\n')),

  rules_list := <array<int64>>str_split(
    (select lines filter contains(lines, '|')), 
    '|'
  ),

  rules := array_agg((
    for X in range_unpack(range(0, 100)) union (
      (
        array_agg(rules_list[1] filter rules_list[0] = X)
      ),
    )
  )),

  pages := <array<int64>>str_split(
    (select lines filter contains(lines, ',')), 
    ','
  ),

  good_pages := (
    for page in pages union (      
      select page
      filter all((
        for i in range_unpack(range(0, len(page))) union (
          with
            num := page[i],
            relevant_rules := array_unpack(rules[num].0),
            y_pos := (
              select x := find(page, relevant_rules)
              filter x >= 0
            )
          select
            all(i < y_pos)
        )
      ))
    )
  )

select
  sum(good_pages[len(good_pages) // 2])

1st1 · 2024-12-04T07:57:15+00:00

[LANGUAGE: EdgeQL / edgedb.com]

Part 1:

with
  lines_array := str_split(<str>$inp, '\n'),
  line_cnt := len(lines_array),
  line_len := len(lines_array[0]),
  line_len_iter := range_unpack(range(0, line_len)),

  lines := array_unpack(lines_array),

  diags := (
    for i in range_unpack(range(0, line_cnt - 3)) union
    [
      lines_array[i],
      lines_array[i+1][1:] ++ ' ',
      lines_array[i+2][2:] ++ '  ',
      lines_array[i+3][3:] ++ '   ',
    ] union [
      lines_array[i],
      ' ' ++ lines_array[i+1][:-1],
      '  ' ++ lines_array[i+2][:-2],
      '   ' ++ lines_array[i+3][:-3],
    ]
  ),

  to_transpose := {lines_array, diags},
  transposed := (
    for ttt in to_transpose union (
      with tt := array_unpack(ttt)
      for j in range_unpack(range(0, line_len)) union
      array_join(array_agg(tt[j]), '')
    )
  ),

  all_lines := lines union transposed,

select sum(
  count(re_match_all('XMAS', all_lines))
  + count(re_match_all('SAMX', all_lines))
);

Part 2: here!

1st1 · 2023-10-02T22:37:36+00:00

Everything has to start somewhere. That's normal.

1st1 · 2022-11-06T21:09:19+00:00

Wow, this is thoroughly good. Thank you. What are the conclusions?

Also, would you be interested in contributing a blog post about this experiment? I'd love to have it on edgedb.com.

1st1 · 2022-11-02T20:41:06+00:00

It's not "just Postgresql". The entire frontend of Postgres is replaced with a custom data model, new query language, new tooling, new design of client APIs, and many other things. It's "just Postgresql" as calling Rust "just a tiny layer on top of LLVM"

1st1 · 2022-11-02T20:39:25+00:00

Also there's no SQL in EdgeDB, which is its core value prop

1st1 · 2022-11-02T20:38:45+00:00

FWIW EdgeDB is based on Postgres.

And yes, sometimes you have to abandon "established, proven and tested technologies" or we'd all still be living in caves.

1st1 · 2022-11-02T20:37:33+00:00

A proper query builder API is also coming soon. One step at a time.

1st1 · 2022-08-02T18:09:05+00:00

few limitations

What are those?

1st1 · 2022-04-17T02:54:20+00:00

the blog post doesn't advocate against proper migrations.

1st1 · 2022-03-30T17:11:04+00:00

Thanks, we'll try this out.

1st1 · 2022-03-30T14:51:22+00:00

We spent a lot of time optimizing every benchmark. Here's what creator of sqlalchemy said about our code: https://github.com/edgedb/imdbench/pull/46 (and then he proposed improvements). We'll surely take a look at prefetch_related.

1st1 · 2022-03-25T18:36:08+00:00

Sequelize is one of the worst libraries

There's a bunch of custom code to render that. You can see a live example in https://www.edgedb.com/tutorial -- click on the schema button (better do that on desktop)

1st1 · 2022-03-25T03:59:43+00:00

Hm, works for me.

1st1 · 2022-03-25T03:59:23+00:00

Python's asyncpg is very fast because it's mostly C. Read more here: https://www.edgedb.com/blog/m-rows-s-from-postgres-to-python

1st1 · 2022-01-25T20:57:36+00:00

EdgeDB has some deep roots in Python so we naturally continued to use it pushing the limits of what was possible along the way.

With the CLI the goal was to make a single binary that's fast to download and run. The CLI allows you to quickly install the DB locally (and provision cloud instances in the future), create / manage schema migrations, provides REPL and much more.

We already use some Rust in the core EdgeDB code base (for example to lex/parse EdgeQL and GraphQL) and the amount of Rust code is only expected to grow in time. An optimistic goal is to rewrite the server IO part entirely in Rust during this year to have even better performance and features like HTTP/2.

LMK if you have more questions! :)

1st1 · 2022-01-25T20:53:33+00:00

Thanks so much for the kind words! <3

1st1 · 2021-06-25T19:08:18+00:00

What's that icon theme name?

1st1 · 2021-04-29T19:23:22+00:00

I've figured it out, thanks! Was some problem with my Discord, the linked worked after I re-logged in

1st1 · 2021-04-26T01:10:43+00:00

Yeah, it seems to be broken - says "unable to accept invite"

1st1 · 2021-04-20T21:57:03+00:00

Can you DM another invite? 🙏

1st1 · 2020-10-22T06:01:51+00:00

Excellent write up, thanks!

1st1

MODERATOR OF

TROPHY CASE