Skip to content

cleanup & update dependencies tree - #347

Closed
hozan23 wants to merge 2 commits into
roapi:mainfrom
twintag:cleanup-deps
Closed

cleanup & update dependencies tree#347
hozan23 wants to merge 2 commits into
roapi:mainfrom
twintag:cleanup-deps

Conversation

@hozan23

@hozan23 hozan23 commented Oct 19, 2024

Copy link
Copy Markdown
Contributor

Hello,

This PR cleans up and updates the dependencies tree for the columnq crate.

There are still two conflicts:

  • ConnectorX is still using arrow version 52. This can be resolved by merging this PR.
  • DeltaLake is still using datafusion 41.0. This will be resolved once they find a fix for this issue. The likely solution would be upgrading to datafusion 42.1 or skipping that version and using datafusion 43

@houqp

houqp commented Oct 20, 2024

Copy link
Copy Markdown
Member

Thanks for the update @hozan23 , for deltalake, you we can also create a temporary fork at https://github.com/roapi/delta-rs to unblock the upgrade. Let me know if you need any help with it.

@hozan23

hozan23 commented Oct 20, 2024

Copy link
Copy Markdown
Contributor Author

Hello @houqp

I think they are currently working on releasing datafusion 42.1 and they will use it with deltalake. we can wait for a few days until they merge it.

@hozan23

hozan23 commented Nov 10, 2024

Copy link
Copy Markdown
Contributor Author

An update:

The DataFusion 43 version has been released; we can continue with this PR once DeltaLake starts using DataFusion 43

@houqp

houqp commented Dec 31, 2024

Copy link
Copy Markdown
Member

@hozan23 do you need any help pushing this over the finish line?

@houqp

houqp commented Jan 1, 2025

Copy link
Copy Markdown
Member

@hozan23 I don't have access to push to your branch, so started a new branch #365 based off yours to finish off the upgrade. Thanks again for the help!

@houqp houqp closed this Jan 1, 2025
@hozan23

hozan23 commented Jan 1, 2025

Copy link
Copy Markdown
Contributor Author

@houqp Thanks for completing the upgrade.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants