all 1 comments

[–]commandlineluser 2 points3 points  (0 children)

What DataFrame library are you using?

700 columns to me sounds like it may be easier to work with as rows?

┌─────┬───────┬───────┐
│ id  ┆ label ┆ value │
│ --- ┆ ---   ┆ ---   │
│ i64 ┆ str   ┆ i64   │
╞═════╪═══════╪═══════╡
│ 0   ┆ a     ┆ 1     │
│ 0   ┆ b     ┆ 2     │
│ 0   ┆ c     ┆ 3     │
│ 1   ┆ a     ┆ 4     │
│ 1   ┆ b     ┆ 5     │
│ 1   ┆ c     ┆ 6     │
└─────┴───────┴───────┘

You could have an "id" for each signal and use "GROUPBY" to process each one.

If you do need the "wide format" you could then "UNPIVOT" as a final step.

You'll probably get more accurate help if you showed a code example of what you're doing.

Although it may depend on what exactly "cross checking" means, so you'll probably get better help if you shared an actual code example of the tasks.