You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
[Parquet][Python] pq.read_table should allow passing MemoryPool #54637
changed the title [-][Python] pq.read_table should allow passing MemoryPool[/-][+][Parquet][Python] pq.read_table should allow passing MemoryPool[/+]on Oct 19, 2026
I'd like to work on this. My plan is to add a memory_pool argument to pq.read_table (and ParquetDataset / ParquetFile.read where it applies) and pass it down to the Parquet reader, with a test using a proxy memory pool to check that the allocations go through it. I'll open a PR once I have it working.
Activity
[-][Python] pq.read_table should allow passing MemoryPool[/-][+][Parquet][Python] pq.read_table should allow passing MemoryPool[/+]omkar-334 commentedon Oct 19, 2026
@pitrou can i work on this? Id like to give this a shot
akshat-lakhera commentedon Oct 19, 2026
take
I'd like to work on this. My plan is to add a
memory_poolargument topq.read_table(andParquetDataset/ParquetFile.readwhere it applies) and pass it down to the Parquet reader, with a test using a proxy memory pool to check that the allocations go through it. I'll open a PR once I have it working.pitrou commentedon Oct 19, 2026
@omkar-334 Feel free to work on this, of course.
@akshat-lakhera You came slightly later, sorry. Also, please avoid posting AI-generated messages.
akshat-lakhera commentedon Oct 19, 2026
Okay @pitrou, will browse some other issues. And will not AI generated messages from now on ^^
apacheGH-54637: [Python][Parquet] Address review comments on memory_p…
apacheGH-54637: [Python][Parquet] Add memory_pool argument to read_table
apacheGH-54637: [Python][Parquet] Add tests for the memory_pool argument
apacheGH-54637: [Python][Parquet] Address review comments on memory_p…
apacheGH-54637: [Python][Parquet] Move memory_pool to ParquetDataset.…
apacheGH-54637: [Python][Parquet] Declare read_kwargs outside the try…
GH-54637: [Python] add `MemoryPool` support to `pq.read_table` (#54919)
AlenkaF commentedon Oct 28, 2026
Issue resolved by pull request 54919
#54919