Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[VL] Velox does not allow duplicate projections in hash probe #8945

Open
zml1206 opened this issue Mar 10, 2025 · 0 comments · May be fixed by #8946
Open

[VL] Velox does not allow duplicate projections in hash probe #8945

zml1206 opened this issue Mar 10, 2025 · 0 comments · May be fixed by #8946
Labels
bug Something isn't working triage

Comments

@zml1206
Copy link
Contributor

zml1206 commented Mar 10, 2025

Backend

VL (Velox)

Bug description

withTable("t1", "t2") {
  Seq((1, "a"), (2, "b")).toDF("c1", "c2").write.saveAsTable("t1")
  Seq(1, 2, 3).toDF("c1").write.saveAsTable("t2")
  val query =
    """
      |select t3.* from
      |(select c1, c2 as a,c2 as b from t1) t3
      |join t2
      |on t3.c1 = t2.c1
      |""".stripMargin
  sql(query).show()
}

ERROR:
An unloaded lazy vector cannot be wrapped by two different top level vectors.

Know from facebookincubator/velox#12563, velox does not allow duplicate projections in hash probe, we need pull out duplicate projections.

Spark version

None

Spark configurations

No response

System information

No response

Relevant logs

@zml1206 zml1206 added bug Something isn't working triage labels Mar 10, 2025
@FelixYBW FelixYBW changed the title Velox does not allow duplicate projections in hash probe [VL] Velox does not allow duplicate projections in hash probe Mar 10, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working triage
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant