Skip to content

[SPARK-54892] Support list data type#272

Closed
dongjoon-hyun wants to merge 2 commits intoapache:mainfrom
dongjoon-hyun:SPARK-54892
Closed

[SPARK-54892] Support list data type#272
dongjoon-hyun wants to merge 2 commits intoapache:mainfrom
dongjoon-hyun:SPARK-54892

Conversation

@dongjoon-hyun
Copy link
Copy Markdown
Member

@dongjoon-hyun dongjoon-hyun commented Jan 4, 2026

What changes were proposed in this pull request?

This PR aims to support list data type by syncing with Apache Arrow Swift project.

Why are the changes needed?

We still cannot use Apache Arrow Swift directly due to the mismatch like apache/arrow#46628. Until we achieve the goal, we need to sync with the upstream to bring newly added but unreleased features.

Does this PR introduce any user-facing change?

No,

How was this patch tested?

Pass the CIs.

Was this patch authored or co-authored using generative AI tooling?

No.

Comment on lines 413 to +430
case ArrowTypeId.string:
return "u"

if let structType = self as? ArrowTypeStruct {
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I wonder why this if let structType = self as? ArrowTypeStruct { is after above return "u" for string type? Shouldn't there be case ArrowTypeId.struct:?

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@dongjoon-hyun
Copy link
Copy Markdown
Member Author

Thank you, @viirya . Spark Swift Connect side test case will be added soon after merging this PR.

@dongjoon-hyun
Copy link
Copy Markdown
Member Author

Merged to main.

@dongjoon-hyun dongjoon-hyun deleted the SPARK-54892 branch January 4, 2026 09:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants