0

I have 2 columns with the following schema in a pyspark dataframe

('pattern', 'array<struct<pattern:string,positions:array<int>>>')

('distinct_patterns', 'array<array<struct<pattern:string,positions:array<int>>>>')

I want to find those rows where pattern is there in distinct patterns

  • 1
    [How to make good reproducible spark dataframe examples](https://stackoverflow.com/questions/48427185/how-to-make-good-reproducible-apache-spark-examples). – pault Aug 12 '19 at 19:08
  • Some sample data will be helpful – niuer Aug 13 '19 at 20:19

0 Answers0